-- Logs begin at Mon 2022-08-22 11:52:02 UTC, end at Mon 2022-08-22 13:07:59 UTC. -- Aug 22 12:38:02.985498 dv-cinder-850836-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 12:38:02.995424 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 12:38:02.996896 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 12:38:02 2022] *** Aug 22 12:38:02.996896 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 12:38:02.996896 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 12:38:02.996896 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: nodename: dv-cinder-850836-6-iscsi Aug 22 12:38:02.996896 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: machine: x86_64 Aug 22 12:38:02.996896 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: clock source: unix Aug 22 12:38:02.996896 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: pcre jit disabled Aug 22 12:38:02.996896 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: detected number of CPU cores: 4 Aug 22 12:38:02.996896 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: current working directory: / Aug 22 12:38:02.996896 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: detected binary path: /usr/bin/uwsgi-core Aug 22 12:38:02.997468 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: your processes number limit is 47680 Aug 22 12:38:02.997468 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: your memory page size is 4096 bytes Aug 22 12:38:02.997468 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: detected max file descriptor number: 2048 Aug 22 12:38:02.997468 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: lock engine: pthread robust mutexes Aug 22 12:38:02.997468 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: thunder lock: enabled Aug 22 12:38:02.997468 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 12:38:02.997468 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 12:38:03.035680 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: Python main interpreter initialized at 0x5617fd6629c0 Aug 22 12:38:03.035680 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: python threads support enabled Aug 22 12:38:03.035680 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: your server socket listen backlog is limited to 100 connections Aug 22 12:38:03.035680 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: your mercy for graceful operations on workers is 90 seconds Aug 22 12:38:03.036008 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 12:38:03.036090 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: *** Operational MODE: preforking *** Aug 22 12:38:03.036329 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: *** uWSGI is running in multiple interpreter mode *** Aug 22 12:38:03.036329 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: spawned uWSGI master process (pid: 112662) Aug 22 12:38:03.036513 dv-cinder-850836-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 12:38:03.037046 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: spawned uWSGI worker 1 (pid: 112663, cores: 1) Aug 22 12:38:03.037361 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: spawned uWSGI worker 2 (pid: 112664, cores: 1) Aug 22 12:38:03.037517 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 12:38:03.697441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 12:38:03.698027 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 12:38:04.779350 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:38:04.779350 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: from cryptography.utils import int_from_bytes Aug 22 12:38:04.780038 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:38:04.780038 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: from cryptography.utils import int_from_bytes Aug 22 12:38:04.780888 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:38:04.780888 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: from cryptography.utils import int_from_bytes Aug 22 12:38:04.781322 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:38:04.781322 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: from cryptography.utils import int_from_bytes Aug 22 12:38:07.287229 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 12:38:07.287870 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 12:38:07.288443 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 12:38:07.288443 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 12:38:07.288600 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 12:38:07.288926 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.289246 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.289562 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.289805 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 12:38:07.290174 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.290295 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 12:38:07.290385 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.290483 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.290641 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 12:38:07.290825 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.290967 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 12:38:07.291110 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.291284 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 12:38:07.291459 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.291571 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.291692 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.291888 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.292001 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.292211 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.292303 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-6-iscsi {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.292532 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.292630 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.292859 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.292962 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.293167 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.293265 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.293485 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.293573 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.293780 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.293866 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.294096 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.294209 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.294385 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.294474 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.294700 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.294902 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.295016 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-6-iscsi {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.295330 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.295425 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.295631 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.295717 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.295936 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.296035 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.296251 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.296340 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.296552 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.296646 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.296852 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.296950 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.297163 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.297250 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.297465 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.297664 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.297775 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.297970 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.298058 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.298294 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.298476 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-6-iscsi {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.298609 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.298776 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.298941 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.299082 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.299802 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.299935 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.300119 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.300341 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.300437 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.300651 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.300759 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.300958 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.301058 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.301269 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.301358 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.301584 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.301693 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-6-iscsi {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.301887 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.302002 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.302223 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.302326 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.302539 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.302630 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.302849 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.303014 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.303162 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.303323 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.303457 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.303630 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.303759 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.303947 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.304063 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.304264 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.304357 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.304567 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.304659 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.304904 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.304993 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.305178 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.305266 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.305480 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.305581 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.305799 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.305893 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.306106 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.306225 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.306437 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.306538 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.306687 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.306782 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.306932 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.307033 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.307242 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.307332 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.307555 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.307651 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.307856 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.307942 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.308156 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.308243 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.308455 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.308559 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.308760 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.308875 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.309060 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.309155 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.309315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.309407 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.309562 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.309669 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.309877 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.309971 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.310226 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.310321 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.310528 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.310633 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.310834 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.310944 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.311137 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.311228 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.311441 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.311544 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.311746 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.311839 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.312053 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.312153 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.312352 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.312464 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.312653 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.312793 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.312966 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.313059 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.313266 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.313357 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.313578 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.313677 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.313881 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.313972 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.314196 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.314289 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.314502 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.314594 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.314829 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.314930 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.315142 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.315240 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.315472 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.315563 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.315775 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.315876 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.316022 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.316135 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.316318 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.316409 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.316617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.316720 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.316926 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.317018 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.317226 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.317314 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.317529 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.317637 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.317831 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.317923 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.318124 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.318370 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.318452 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.318533 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.318728 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.318819 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.319025 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.319121 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.319367 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.319461 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.319620 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.319722 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.319917 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.320005 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.320220 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.320308 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.320518 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.320605 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.320818 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.320916 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.321125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.321218 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.321430 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.321523 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.321729 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.321830 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.322050 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.322144 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.322350 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.322454 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.322650 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.322740 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.322954 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.323044 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.323256 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.323346 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.323555 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.323647 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.323868 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.323970 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.324168 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.324257 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.324468 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.324555 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.324770 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.324859 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.325070 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.325157 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.325371 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.325467 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.325688 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.325788 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.325983 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.326069 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.326304 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.326409 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.326615 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.326709 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.326917 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.327013 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.327217 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.327313 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.327514 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.327617 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.327817 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.327925 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.328114 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.328211 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.328415 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.328503 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.328713 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.328809 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.329012 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.329110 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.329306 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.329394 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.329614 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.329701 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.329919 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.330020 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.330239 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.330330 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.330569 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.330669 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.330874 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.330980 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.331176 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.331268 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.331477 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.331569 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.331777 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.331877 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.332075 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.332167 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.332390 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.332488 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.332708 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.332808 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.333018 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.333113 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.333324 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.333425 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.333627 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.333719 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.333941 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:38:07.334040 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.334283 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.334393 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.334594 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.334697 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.334900 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.334991 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.335208 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.335310 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.335519 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.335668 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.335836 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.335987 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.336160 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.336314 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.336453 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.336588 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.336770 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.336932 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.337086 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.337230 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.337390 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.337542 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.337681 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.337817 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.337961 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.338108 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.338303 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.338450 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.338611 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.338766 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.338928 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.339093 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.339233 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.339371 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.339541 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.339685 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.339861 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.340006 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.340173 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.340317 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.340479 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.340630 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.340778 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.340927 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.341065 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.341451 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.341635 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.341779 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.341963 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.342117 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.342328 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.342468 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.342607 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.342753 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.342898 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.343077 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.343240 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.343380 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.343525 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.343673 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.343811 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.343949 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.344086 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.344233 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.344458 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.344610 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.344758 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.344899 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.345047 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.345185 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.345337 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.345550 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.345691 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.345828 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.345973 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.346612 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.346751 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.346924 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.347070 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.347240 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.347392 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.347549 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.347701 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.347841 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.347977 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.348145 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.348297 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.348436 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.348582 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.348747 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.348903 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.349068 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.349213 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.349372 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.349535 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.349675 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.349811 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.349980 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.350222 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.350369 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.350520 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.350659 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.350796 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.350934 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.351070 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.351219 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.351358 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.351506 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.351644 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.351789 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.351929 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.352080 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.352220 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.352357 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.352494 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.352631 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.352780 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.352932 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.353131 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.353275 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.353436 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.353582 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.353720 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.353867 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.354007 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.354146 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.354310 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.354449 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.354599 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.354737 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.354884 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.355021 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.355170 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.355308 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.355459 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.355622 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.355767 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.355937 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.356082 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.356246 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.356398 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.356544 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.356682 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.356846 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.356998 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.357154 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.357303 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.357449 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.357587 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.357814 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.357974 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.358128 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.358318 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.358464 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.358622 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.358767 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.358911 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.359064 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.359220 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.359367 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.359511 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.359654 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.359797 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.359950 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.360095 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.360247 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.360392 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.360536 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.360679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.360836 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.360992 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.361136 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.361280 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.361432 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.361591 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.362322 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.362492 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.362651 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.362798 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.362949 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.363102 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.363288 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.363532 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.363701 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.363854 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.363999 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.364153 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.364305 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.364452 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.364598 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.364741 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.364895 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.365049 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.365195 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.365338 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.365483 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.365638 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.365791 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.365948 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.366095 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.366296 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.366455 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.366602 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.366756 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.366902 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.367045 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.367191 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.367336 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.367498 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.367666 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.367812 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.367956 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.368106 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.368250 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.368393 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.368545 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.368691 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.368836 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.368979 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.369129 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.369282 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.369427 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.369581 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.369734 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.369879 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.370029 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.370213 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.370366 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.370510 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.370669 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.370817 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.370961 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.371113 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.371258 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.371419 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.371564 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.371715 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.371869 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.372024 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.372170 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.372314 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.372458 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.372603 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.372747 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.372899 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.373053 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.373198 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.373394 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.373542 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.373695 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.373841 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.373987 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.374131 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.374522 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.374676 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.374908 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.375058 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.375203 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.375347 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.375490 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.375644 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.375798 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.375944 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.376096 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.376248 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.376393 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.376544 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.376697 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.376842 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.376986 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.377131 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.377298 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.377458 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.377614 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.377759 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.377902 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.378045 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.378264 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.378429 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.378577 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.378721 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.378872 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.379017 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.379161 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.379314 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.379459 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.379620 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.379766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.379766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.380038 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.380191 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.380344 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.380488 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.380632 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.380775 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.380927 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.381072 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.381223 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.381379 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.381531 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.381682 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.381835 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.381982 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.382126 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.382317 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.382464 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.382609 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.382765 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.382911 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.383061 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.383206 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.383360 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.383559 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.383714 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.383860 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.384002 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.384146 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.384290 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.384435 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.384589 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.384755 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.384912 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.385098 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.385244 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.385407 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.385554 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.385705 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.385851 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.385995 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.386147 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.386328 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.386481 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.386627 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.386779 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.386931 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.387076 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.387229 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.387383 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.387527 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.387679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.387832 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.387976 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.388130 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.388275 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.388420 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.388571 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.388726 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.388879 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.389042 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.389188 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.389353 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.389498 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.389642 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.389795 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.389940 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.390083 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.390249 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.390399 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.390544 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.390708 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.390855 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.390999 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.391153 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.391297 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.391449 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.391603 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.391748 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.391893 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.392037 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.392180 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.392333 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.392477 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.392477 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.392764 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.393394 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.393593 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.393775 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.393927 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.394072 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.394238 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.394389 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.394534 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.394696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.394845 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.394991 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.395143 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.395288 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.395432 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.395596 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.395749 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.395909 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.396070 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.396223 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.396375 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.396375 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.396667 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.396819 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.396964 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.397122 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.397268 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.397430 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.397576 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.397720 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.397870 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.398022 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.398175 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.398411 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.398565 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.398717 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.398717 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.398992 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.399143 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.399297 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.399466 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.399621 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.399767 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.399916 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.400061 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.400206 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.400359 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.400504 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.400647 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.400798 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.400943 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.401092 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.401251 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.401407 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.401551 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.401695 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.401846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.401992 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.402146 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.402322 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.402469 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.402614 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.402758 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.402913 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.403059 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.403205 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.403360 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.403505 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.403695 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.403854 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.403999 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.404144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.404288 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.404440 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.404586 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.404753 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.404899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.405050 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.405214 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.405360 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.405512 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.405667 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.405822 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.405968 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.406120 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.406287 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.406403 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.406494 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.406586 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.406671 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.406754 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.406834 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.406925 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407008 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407096 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407178 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407258 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407337 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407426 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407509 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407596 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407678 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407757 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407846 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.407928 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.408049 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.408149 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.408360 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.408450 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.409218 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.409322 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.409524 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.409618 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.409837 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.409938 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.410139 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.410259 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.410463 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.410552 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.410773 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.410869 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.411070 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.411158 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.411370 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.411459 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.411672 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.411842 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.411990 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.412140 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.412296 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.412441 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.412593 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.412747 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.412894 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.413038 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.413181 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.413325 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.413469 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.413622 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.413815 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.413972 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.414118 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.414306 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.414453 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.414610 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.414757 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.414903 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.415055 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.415209 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.415354 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.415510 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.415656 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.415800 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.415946 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.416090 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.416253 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.416399 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.416551 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.416696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.416848 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.417001 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.417156 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.417302 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.417452 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.417599 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.417744 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.417888 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.418047 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.418225 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.418376 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.418520 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.418663 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.418808 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.418965 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.419112 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.419263 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.419408 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.419560 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.419715 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.419860 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.420020 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.420166 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.420310 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.420455 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.420608 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.420761 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.420907 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.421052 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.421197 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.421355 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.421510 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.421655 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.421799 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.421954 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.422107 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.422285 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.422441 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.422594 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.422739 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.422883 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.423028 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.423181 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.423341 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.423487 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.423631 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.423775 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.423982 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.424155 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.424319 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.424465 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.424610 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.424761 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.424907 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.425069 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.425215 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.425361 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.425512 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.425665 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.425809 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.426008 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.426155 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.426290 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.426379 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.426474 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.426566 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.426648 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.426736 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.426818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.426898 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.426978 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.427066 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.427206 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.427333 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.427512 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.427644 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.427818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.427957 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.428122 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.428259 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.428430 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.428561 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.428738 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.428879 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.429043 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.429187 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.429354 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.429510 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.429666 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.429813 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.429958 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.430102 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.430284 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.430433 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.430588 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.430733 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.430877 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.431022 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.431177 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.431321 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.431478 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.431626 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.431770 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.431914 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.432059 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.432203 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.432424 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.432579 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.432726 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.432870 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.433015 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.433178 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.433324 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.433469 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.433619 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.433766 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.433952 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.434109 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.434302 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.434390 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.434484 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.434568 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.434766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.434866 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.435079 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.435169 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.435387 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.435475 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.435687 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.435784 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.436045 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.436134 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.436350 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.436438 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.436660 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.436750 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.436962 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.437050 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.437273 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.437382 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.437573 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.437694 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.437879 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.438003 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.438214 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.438329 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.438520 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.438640 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.438820 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.438948 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.439118 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.439263 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.439446 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.439583 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.439719 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.439888 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.440058 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.440305 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.440468 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.440602 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.440775 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.440913 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.441071 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.441217 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.441468 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.441606 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.441775 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.441914 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.442066 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.442276 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.442428 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.442574 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.442718 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.442862 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.443014 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.443186 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.443335 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.443481 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.443625 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.443768 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.443925 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.444113 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.444261 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.444404 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.444638 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.444822 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.444986 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.445143 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.445299 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.445453 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.445619 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.445779 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.445926 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.446072 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.446282 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.446443 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.446591 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.446735 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.446880 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.447024 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.447188 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.447335 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.447482 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.447633 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.447787 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.447940 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.448095 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.448249 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.448397 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.448550 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.448697 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.448851 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.448998 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.449153 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.449299 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.449443 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.449618 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.449839 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.449988 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.450134 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.450306 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.450453 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.450598 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.450756 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.450902 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.451058 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.451203 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.451203 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.451485 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.451641 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.451796 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.451941 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.452093 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.452250 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.452409 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.452557 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.452703 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.452848 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.453003 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.453167 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.453329 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.453484 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.453637 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.453784 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.453928 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.454116 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.454308 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.454456 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.454601 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.454746 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.454890 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.455045 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.455200 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.455348 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.456000 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.456160 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.456314 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.456471 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.456618 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.456763 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.456908 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.457053 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.457196 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.457350 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.457505 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.457658 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.457804 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.457949 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.458093 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.458269 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.458422 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.458567 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.458719 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.458871 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.459025 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.459180 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.459337 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.459482 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.459627 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.459771 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.459924 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.460079 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.460225 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.460370 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.460514 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.460664 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.460819 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.460965 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.461110 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.461271 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.461418 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.461570 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.461725 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.461871 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.462016 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.462161 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.462348 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.462495 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.462650 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.462806 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.462961 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.463115 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.463274 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.463428 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.463574 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.463719 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.463863 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.464009 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.464204 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.464425 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.464578 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.464723 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.464875 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.465028 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.465191 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.465347 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.465508 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.465655 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.465808 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.465961 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.466107 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.466543 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.466639 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.466731 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.466821 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.466904 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.466998 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.467079 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.467168 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.467257 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.467339 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.467418 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.467507 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.467588 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.467750 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.467867 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.468053 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.468172 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.468357 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.468487 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.468659 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.468796 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.468997 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.469106 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.469300 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.469618 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.469708 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.469925 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.470015 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.470263 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.470369 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.470577 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.470691 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.470883 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.470973 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.471244 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.471345 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.471555 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.471651 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.471861 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.471958 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.472167 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.472275 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.472471 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.472564 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.472779 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.472879 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.473094 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.473184 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.473405 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.473493 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.473719 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.473816 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.474044 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.474264 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.474436 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.474596 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.474733 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.474898 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.475035 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.475212 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.475357 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.475525 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.475663 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.475839 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.475975 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.476153 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.476290 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.476463 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.476620 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.476764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.476901 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.477067 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.477205 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.477370 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.477516 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.477674 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.477813 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.477982 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.478125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.478380 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.478529 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.478675 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.478813 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.478949 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.479084 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.479234 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.479370 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.479504 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.479639 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.479774 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.479936 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.480104 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.480249 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.480404 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.480539 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.480693 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.480847 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.481002 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.481149 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.481294 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.481437 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.481666 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.481826 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.481974 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.482120 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.482306 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.482480 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.482627 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.482788 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.482935 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.483080 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.483224 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.483369 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.483525 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.483680 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.483827 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.483971 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.484135 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.484326 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.484490 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.484637 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.484781 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.484926 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.485110 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.485268 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.485423 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.485570 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.485722 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.485867 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.486011 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.486191 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.486345 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.486488 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.487132 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.487281 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.487434 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.487589 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.487860 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.488012 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.488184 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.488344 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.488490 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.488643 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.488799 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.488953 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.489099 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.489269 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.489417 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.489570 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.489716 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.489867 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.490013 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.490157 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.490346 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.490495 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.490654 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.490801 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.490954 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.491100 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.491253 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.491400 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.491554 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.491700 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.491845 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.491994 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.492149 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.492295 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.492440 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.492596 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.492754 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.492900 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.493058 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.493205 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.493354 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.493501 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.493646 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.493798 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.493944 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.494095 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.494278 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.494468 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.494630 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.494789 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.494943 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.495088 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.495233 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.495385 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.495538 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.495695 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.495841 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.495985 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.496129 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.496273 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.496424 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.496592 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.496740 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.496892 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.497038 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.497182 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.497335 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.497481 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.497625 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.497777 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.497923 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.498067 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.498250 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.498413 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.498560 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.498704 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.498857 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.499004 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.499158 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.499304 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.499449 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.499600 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.499746 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.499897 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.500052 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.500199 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.500353 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.500498 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.500656 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.500816 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.500963 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.501108 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.501252 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.501396 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.501539 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.501539 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.501828 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.501973 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.502125 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.502368 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.502517 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.502684 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.502833 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.502979 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.503131 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.503277 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.503422 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.503575 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.503721 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.503866 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.504011 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.504155 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.504326 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.504516 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.504668 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.504813 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.504957 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.505102 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.505258 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.505405 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.505557 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.505702 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.505847 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.505991 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.506155 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.506329 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.506475 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.506619 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.506762 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.506986 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.507144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.507297 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.507442 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.507587 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.507731 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.507884 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.508029 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.508186 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.508341 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.508486 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.508631 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.508785 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.508939 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.509085 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.509230 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.509374 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.509525 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.509684 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.509829 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.509984 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.510129 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.510296 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.510458 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.510612 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.510759 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.510904 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.511048 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.511200 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.511356 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.511502 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.511653 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.511799 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.511961 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.512107 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.512263 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.512410 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.512555 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.512700 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.512846 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.512999 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.513146 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.513291 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.513436 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.513581 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.513739 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.513894 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.514041 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.514233 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.514395 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.514585 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.514737 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.514895 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.515043 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.515188 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.515340 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.515486 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.515651 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.515798 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.515952 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.516099 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.516243 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.516396 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.516555 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.516703 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.516848 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.516992 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.517137 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.517284 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.517438 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.517594 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.517740 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.518416 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.518570 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.518730 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.518886 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.519032 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.519184 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.519330 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.519474 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.519627 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.519775 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.519930 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.520088 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.520235 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.520380 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.520538 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.520685 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.520831 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.520976 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.521120 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.521265 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.521418 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.521565 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.521709 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.521709 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.521996 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.522149 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.522332 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.522479 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.522634 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.522781 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.522928 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.523086 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.523233 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.523385 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.523531 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.523694 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.523847 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.524003 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.524149 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.524301 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.524446 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.524589 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.524784 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.524931 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.525077 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.525230 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.525376 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.525520 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.525688 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.525835 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.525986 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.526141 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.526286 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.526383 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.526485 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.526572 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.526654 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.526735 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.526815 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.526904 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.527000 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.527188 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.527288 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.527511 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.527649 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.527814 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.527907 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.528111 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.528201 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.528417 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.528508 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.528720 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.528811 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.529022 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.529111 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.529322 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.529419 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.529622 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.529711 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.529921 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.530010 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.530244 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.530348 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.530569 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.530663 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.530890 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.530979 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.531191 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.531290 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.531501 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.531588 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.531814 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.531902 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.532123 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.532220 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.532431 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.532519 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.532737 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.532826 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.533048 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.533158 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.533355 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.533557 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.533712 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.533857 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.534012 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.534159 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.534393 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.534540 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.534738 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.534890 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.535125 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.535285 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.535432 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.535577 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.535730 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.535877 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.536034 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.536187 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.536333 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.536486 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.536633 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.536778 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.536932 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.537096 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.537285 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.537439 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.537586 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.537751 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.537904 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.538051 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.538051 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.538365 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.538365 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.538655 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.538655 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.538954 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.539108 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.539253 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.539405 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.539561 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.539708 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.539860 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.540006 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.540151 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.540151 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 12:38:07.540442 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.540442 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.540758 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.540936 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.541248 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.541573 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.541896 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.542238 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.542565 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.542888 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.543231 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.543541 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.543882 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.544206 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.544518 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.544828 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.545134 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:38:07.545375 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 12:38:07.693414 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO dbcounter [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Registered counter for database nova_api Aug 22 12:38:07.699232 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO dbcounter [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Registered counter for database nova_api Aug 22 12:38:07.714442 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_db.sqlalchemy.engines [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:38:07.718987 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG oslo_db.sqlalchemy.engines [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:38:07.721232 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writer thread running {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:38:07.725388 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG dbcounter [-] [112663] Writer thread running {{(pid=112663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:38:07.776579 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.context [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9cc14116-d0bf-4920-ba82-d0258dbf20da(cell1) {{(pid=112664) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 12:38:07.780392 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:38:07.780619 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.context [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9cc14116-d0bf-4920-ba82-d0258dbf20da(cell1) {{(pid=112663) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 12:38:07.780858 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:38:07.782450 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:38:07.783186 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:38:07.784168 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:38:07.784956 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG oslo_concurrency.lockutils [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:38:07.785434 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG oslo_concurrency.lockutils [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:38:07.786140 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:38:07.787047 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG oslo_concurrency.lockutils [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:38:07.787831 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG oslo_concurrency.lockutils [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:38:07.788117 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO dbcounter [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Registered counter for database nova_cell0 Aug 22 12:38:07.788219 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG oslo_concurrency.lockutils [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:38:07.790205 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG oslo_concurrency.lockutils [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:38:07.792252 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO dbcounter [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Registered counter for database nova_cell0 Aug 22 12:38:07.793369 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO dbcounter [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Registered counter for database nova_cell1 Aug 22 12:38:07.797704 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO dbcounter [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Registered counter for database nova_cell1 Aug 22 12:38:07.801690 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_db.sqlalchemy.engines [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:38:07.803461 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_db.sqlalchemy.engines [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:38:07.805504 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG oslo_db.sqlalchemy.engines [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:38:07.807482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG oslo_db.sqlalchemy.engines [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:38:07.808086 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writer thread running {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:38:07.814395 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG dbcounter [-] [112663] Writer thread running {{(pid=112663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:38:07.815931 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG dbcounter [-] [112663] Writer thread running {{(pid=112663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:38:07.945358 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writer thread running {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:38:07.954054 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO dbcounter [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Registered counter for database nova_cell0 Aug 22 12:38:07.959126 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO dbcounter [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Registered counter for database nova_cell0 Aug 22 12:38:07.963712 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_db.sqlalchemy.engines [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:38:07.967837 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG oslo_db.sqlalchemy.engines [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:38:07.968287 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writer thread running {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:38:07.972257 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG dbcounter [-] [112663] Writer thread running {{(pid=112663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:38:08.410985 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: WARNING keystonemiddleware.auth_token [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 12:38:08.418237 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: WARNING keystonemiddleware.auth_token [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 12:38:08.426648 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: WARNING keystonemiddleware.auth_token [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 12:38:08.433809 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: WARNING keystonemiddleware.auth_token [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 12:38:08.764595 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: WARNING keystonemiddleware.auth_token [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 12:38:08.770574 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: WARNING keystonemiddleware.auth_token [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 12:38:08.775815 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5617fd6629c0 pid: 112664 (default app) Aug 22 12:38:08.777842 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:38:08.779043 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 Aug 22 12:38:08.779456 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Mon Aug 22 12:38:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:38:08.783339 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: WARNING keystonemiddleware.auth_token [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 12:38:08.789816 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: WARNING keystonemiddleware.auth_token [None req-e82fbd7a-9d9d-4b32-b6d3-c229a99d9516 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 12:38:08.795112 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5617fd6629c0 pid: 112663 (default app) Aug 22 12:39:28.714304 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:28.715301 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 22 12:39:28.715880 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:39:28.730745 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG dbcounter [-] [112663] Writing DB stats nova_api:SELECT=3 {{(pid=112663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:28.731934 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG dbcounter [-] [112663] Writing DB stats nova_cell0:SELECT=3 {{(pid=112663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:28.733021 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG dbcounter [-] [112663] Writing DB stats nova_cell1:SELECT=3 {{(pid=112663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:28.734206 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG dbcounter [-] [112663] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:29.614205 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-31094b26-9723-42f4-9258-bc15c4ebc652 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:29.649098 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-31094b26-9723-42f4-9258-bc15c4ebc652 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.923377 Aug 22 12:39:29.650226 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 22 12:39:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:39:31.994971 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:31.995996 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-b918d7e1-41b3-477e-bd32-e67f59bb1f71 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 22 12:39:32.004075 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:39:32.435998 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-7045606a-801b-402a-a48d-d8de4293c30d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "cirros256", "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:32.456821 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:39:32.456821 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: warnings.warn(msg) Aug 22 12:39:32.546142 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-7045606a-801b-402a-a48d-d8de4293c30d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.542843 Aug 22 12:39:32.547393 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 22 12:39:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:39:32.562149 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writing DB stats nova_api:SELECT=3 {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:32.563385 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writing DB stats nova_cell0:SELECT=3 {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:32.564500 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writing DB stats nova_cell1:SELECT=3 {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:32.565574 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:32.791936 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-d736b1af-50f8-437e-aa73-747b25059887 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:32.796307 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:39:32.796307 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: warnings.warn(msg) Aug 22 12:39:32.948212 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-d736b1af-50f8-437e-aa73-747b25059887 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.392082 Aug 22 12:39:32.948799 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 22 12:39:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:39:35.311204 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-7045606a-801b-402a-a48d-d8de4293c30d admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:35.312746 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-7045606a-801b-402a-a48d-d8de4293c30d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 Aug 22 12:39:35.313286 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:39:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:39:36.087988 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-8d94fc28-4b16-4f9f-80be-69a9f72944e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:36.107554 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:39:36.107554 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: warnings.warn(msg) Aug 22 12:39:36.247394 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-8d94fc28-4b16-4f9f-80be-69a9f72944e1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.927820 Aug 22 12:39:36.248282 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 22 12:39:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:39:36.262412 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-5e6e0fcc-8550-47e0-bb58-a53d96ca4899 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:36.265901 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:39:36.265901 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: warnings.warn(msg) Aug 22 12:39:36.397580 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-5e6e0fcc-8550-47e0-bb58-a53d96ca4899 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140152 Aug 22 12:39:36.402362 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 22 12:39:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:39:38.745178 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-8d94fc28-4b16-4f9f-80be-69a9f72944e1 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:38.746203 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-8d94fc28-4b16-4f9f-80be-69a9f72944e1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 22 12:39:38.746621 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:39:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:39:39.143408 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-fac3bd04-6c31-4953-a229-29efdaeeb09b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10}} {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:39.203758 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-fac3bd04-6c31-4953-a229-29efdaeeb09b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451110 Aug 22 12:39:39.204959 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 22 12:39:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:39:39.216913 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-2a9a1fdc-e425-4a37-be70-66727812504c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:39.289741 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-2a9a1fdc-e425-4a37-be70-66727812504c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076494 Aug 22 12:39:39.290796 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 22 12:39:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:39:41.655040 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-fac3bd04-6c31-4953-a229-29efdaeeb09b admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:41.656046 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-fac3bd04-6c31-4953-a229-29efdaeeb09b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 22 12:39:41.656444 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:39:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:39:42.080077 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-0114671f-5013-4471-91d7-3a88761df03e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "vcpus": 2}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:42.154079 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-0114671f-5013-4471-91d7-3a88761df03e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490690 Aug 22 12:39:42.155572 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 22 12:39:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:39:42.168795 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-fb12eb54-7393-4c9d-9cad-e0cacbd35cac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:42.265886 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-fb12eb54-7393-4c9d-9cad-e0cacbd35cac admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101389 Aug 22 12:39:42.268395 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 22 12:39:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:39:44.641334 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-0114671f-5013-4471-91d7-3a88761df03e admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:44.642931 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-0114671f-5013-4471-91d7-3a88761df03e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Aug 22 12:39:44.643323 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:39:45.054680 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-1ed643e4-0521-4416-8e41-aa8ab6064484 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "id": "d4", "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:45.164048 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-1ed643e4-0521-4416-8e41-aa8ab6064484 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514299 Aug 22 12:39:45.164594 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 22 12:39:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 12:39:45.177206 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-79a7aefb-bc50-4d6b-bc20-fa1b3d7a13e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:45.244293 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-79a7aefb-bc50-4d6b-bc20-fa1b3d7a13e1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070928 Aug 22 12:39:45.252298 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 22 12:39:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:39:48.056783 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-1ed643e4-0521-4416-8e41-aa8ab6064484 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:48.057828 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-1ed643e4-0521-4416-8e41-aa8ab6064484 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 22 12:39:48.058255 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:39:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:39:48.489797 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-320a6aa8-f233-489e-8bc6-2bc5e374f449 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:48.519948 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-320a6aa8-f233-489e-8bc6-2bc5e374f449 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454818 Aug 22 12:39:48.520471 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 22 12:39:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:39:50.895738 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-1ed643e4-0521-4416-8e41-aa8ab6064484 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:50.897008 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-1ed643e4-0521-4416-8e41-aa8ab6064484 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Aug 22 12:39:50.897576 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:39:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:39:51.320421 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-82d9013e-7511-4eb3-829e-34ffd854406c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:51.398782 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-82d9013e-7511-4eb3-829e-34ffd854406c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.495023 Aug 22 12:39:51.399333 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 22 12:39:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 12:39:51.411540 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-d3c00390-e6aa-4839-ba35-b38030636751 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:51.470949 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-d3c00390-e6aa-4839-ba35-b38030636751 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063156 Aug 22 12:39:51.471647 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 22 12:39:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:39:53.803649 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-82d9013e-7511-4eb3-829e-34ffd854406c admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:53.804680 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-82d9013e-7511-4eb3-829e-34ffd854406c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 22 12:39:53.805043 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:39:54.185216 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-3dc22bfa-303a-4e96-b13c-7a871e5b9981 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "vcpus": 1}} {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:54.255046 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-3dc22bfa-303a-4e96-b13c-7a871e5b9981 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.443682 Aug 22 12:39:54.255602 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 22 12:39:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:39:54.268246 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-9b238705-7342-4f67-b98d-f871e8d97fe9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:54.356529 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-9b238705-7342-4f67-b98d-f871e8d97fe9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092383 Aug 22 12:39:54.357136 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 22 12:39:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:39:57.019712 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-3dc22bfa-303a-4e96-b13c-7a871e5b9981 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:39:57.020821 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-3dc22bfa-303a-4e96-b13c-7a871e5b9981 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Aug 22 12:39:57.021417 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:39:57.491951 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-da414e4c-06b0-42bd-a9a8-ba097ee1c199 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "id": "3", "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:57.583850 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-da414e4c-06b0-42bd-a9a8-ba097ee1c199 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.555796 Aug 22 12:39:57.584640 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 22 12:39:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 12:39:57.597253 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-01c0e015-99b3-48a2-97d9-2147eced21e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:39:57.683088 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-01c0e015-99b3-48a2-97d9-2147eced21e6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089781 Aug 22 12:39:57.683924 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 22 12:39:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:40:00.084402 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-da414e4c-06b0-42bd-a9a8-ba097ee1c199 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:00.085399 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-da414e4c-06b0-42bd-a9a8-ba097ee1c199 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 22 12:40:00.085797 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:40:00.601427 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-857d33ef-2b87-468e-bf8e-5df11faa9f90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "disk": 80}} {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:40:00.611575 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG dbcounter [-] [112663] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:01.473318 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-857d33ef-2b87-468e-bf8e-5df11faa9f90 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.381514 Aug 22 12:40:01.473959 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 22 12:40:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:40:01.486651 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-7012d187-5197-4d6b-8046-8609fe38166d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:40:01.591569 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-7012d187-5197-4d6b-8046-8609fe38166d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109126 Aug 22 12:40:01.592150 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 22 12:40:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:40:03.968584 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-857d33ef-2b87-468e-bf8e-5df11faa9f90 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:03.970567 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-857d33ef-2b87-468e-bf8e-5df11faa9f90 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001808 Aug 22 12:40:03.970802 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:40:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:40:04.415332 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-f11cd028-b4a7-454a-a51b-15f78f9624ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:40:04.507412 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-f11cd028-b4a7-454a-a51b-15f78f9624ba admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.530235 Aug 22 12:40:04.510229 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 22 12:40:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:40:04.520866 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-f86a4cd8-5c3b-4bb7-8e3c-bf9acb07cf0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:40:04.607893 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-f86a4cd8-5c3b-4bb7-8e3c-bf9acb07cf0e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091134 Aug 22 12:40:04.610852 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 22 12:40:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:40:22.910739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-f11cd028-b4a7-454a-a51b-15f78f9624ba admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:22.911668 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-f11cd028-b4a7-454a-a51b-15f78f9624ba admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 22 12:40:22.912105 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:40:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:40:23.429074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-bce9d29b-824c-426b-8ee9-d9992faff26c admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:23.447957 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-bce9d29b-824c-426b-8ee9-d9992faff26c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.529985 Aug 22 12:40:23.448763 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 22 12:40:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:40:24.512594 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-f11cd028-b4a7-454a-a51b-15f78f9624ba admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:24.513591 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-f11cd028-b4a7-454a-a51b-15f78f9624ba admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 22 12:40:24.513985 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:40:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:40:25.038819 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-3f2562db-9abb-49a6-8c20-6b1300e5b920 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:25.044415 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.wsgi [None req-3f2562db-9abb-49a6-8c20-6b1300e5b920 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-3f2562db-9abb-49a6-8c20-6b1300e5b920 admin admin] Request method failure captured: Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Accept: application/json Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Accept-Encoding: gzip, deflate Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Connection: keep-alive Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Content-Length: 0 Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Host: 10.222.0.15 Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Openstack-Api-Version: compute 2.90 Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Openstack-System-Scope: None Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: User-Agent: python-novaclient Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Auth-Token: gAAAAABjA3k4g-TADIPcSfve-xoVb2Es6Jv1gu1sjOQGEEWpOit5PjOIjqFT2eWISbdcDhHv_HJ1EWXGKU0nhdbxlF3VFTyuvqwg4TmDXciLtLL-WDgzwWxRAudOKRDqbaJJq2xW6t0jva5iqNe_Zhrk-HIZZzWezs6bOPbKAYVHXBybkQxbVSA Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Domain-Id: None Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Domain-Name: None Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Identity-Status: Confirmed Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Is-Admin-Project: True Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Domain-Id: default Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Domain-Name: Default Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Name: admin Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Role: admin,member,reader Aug 22 12:40:25.047679 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Roles: admin,member,reader Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2da9e1885c75493abe2144dd979376b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2da9e1885c75493abe2144dd979376b4"}]}] Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Tenant: admin Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Tenant-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Tenant-Name: admin Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User: admin Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Domain-Id: default Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Domain-Name: Default Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Id: eb451a0ed5164dd0a6301058cedf4d62 Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Name: admin Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: method: > Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: exception: Flavor 42 could not be found. Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: action_args: {'id': '42'} Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:40:25.049315 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:25.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:25.052074 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-3f2562db-9abb-49a6-8c20-6b1300e5b920 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:40:25.053320 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-3f2562db-9abb-49a6-8c20-6b1300e5b920 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397943 Aug 22 12:40:25.053320 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 22 12:40:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:25.058748 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-6e774dd7-4c29-4c6e-b779-ab5fc417b99a admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:25.063062 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:25.082470 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-6e774dd7-4c29-4c6e-b779-ab5fc417b99a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027228 Aug 22 12:40:25.083024 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 22 12:40:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:40:25.092538 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-61550d50-1b4a-4aba-9f6a-a651539f21a7 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:25.115951 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-61550d50-1b4a-4aba-9f6a-a651539f21a7 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026912 Aug 22 12:40:25.116469 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 22 12:40:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:40:25.126542 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-3d2a02d3-5d29-439d-9f49-1af01b7e64b8 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:25.132551 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.wsgi [None req-3d2a02d3-5d29-439d-9f49-1af01b7e64b8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-3d2a02d3-5d29-439d-9f49-1af01b7e64b8 admin admin] Request method failure captured: Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Accept: application/json Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Accept-Encoding: gzip, deflate Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Connection: keep-alive Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Content-Length: 0 Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Host: 10.222.0.15 Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Openstack-Api-Version: compute 2.90 Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Openstack-System-Scope: None Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: User-Agent: python-novaclient Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Auth-Token: gAAAAABjA3k4g-TADIPcSfve-xoVb2Es6Jv1gu1sjOQGEEWpOit5PjOIjqFT2eWISbdcDhHv_HJ1EWXGKU0nhdbxlF3VFTyuvqwg4TmDXciLtLL-WDgzwWxRAudOKRDqbaJJq2xW6t0jva5iqNe_Zhrk-HIZZzWezs6bOPbKAYVHXBybkQxbVSA Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Domain-Id: None Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Domain-Name: None Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Identity-Status: Confirmed Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Is-Admin-Project: True Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Domain-Id: default Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Domain-Name: Default Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Name: admin Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Role: admin,member,reader Aug 22 12:40:25.135818 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Roles: admin,member,reader Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2da9e1885c75493abe2144dd979376b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2da9e1885c75493abe2144dd979376b4"}]}] Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Tenant: admin Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Tenant-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Tenant-Name: admin Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User: admin Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Domain-Id: default Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Domain-Name: Default Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Id: eb451a0ed5164dd0a6301058cedf4d62 Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Name: admin Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: method: > Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: exception: Flavor 42 could not be found. Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: action_args: {'id': '42'} Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:40:25.139821 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:25.140617 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:25.142292 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-3d2a02d3-5d29-439d-9f49-1af01b7e64b8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:40:25.143307 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-3d2a02d3-5d29-439d-9f49-1af01b7e64b8 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015061 Aug 22 12:40:25.143307 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 22 12:40:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:26.090681 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-61550d50-1b4a-4aba-9f6a-a651539f21a7 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:26.091724 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-61550d50-1b4a-4aba-9f6a-a651539f21a7 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 22 12:40:26.092120 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:40:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:40:26.612650 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-0503a731-6367-4544-9fc0-afe5cc5c2c33 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:26.617918 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.wsgi [None req-0503a731-6367-4544-9fc0-afe5cc5c2c33 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-0503a731-6367-4544-9fc0-afe5cc5c2c33 admin admin] Request method failure captured: Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Accept: application/json Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Accept-Encoding: gzip, deflate Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Connection: keep-alive Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Content-Length: 0 Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Host: 10.222.0.15 Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Openstack-Api-Version: compute 2.90 Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Openstack-System-Scope: None Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: User-Agent: python-novaclient Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Auth-Token: gAAAAABjA3k5ZFJiev34gzG_epn1bM5geAvlEXKhVNr6Em9ofwTHHKtgNkNYp5cjv7CDf4sDpbxRZnfLnw6hLdeOHXSUNY8d6K9O1Hk1kZ7Y2MxO9yNQBU6AKkIOZiedhRSkrxLFhpQyzMlX6v4MBnFgj1YNMGBPzZOyTTHPrNVMrgC6PPTQ4-g Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Domain-Id: None Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Domain-Name: None Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Identity-Status: Confirmed Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Is-Admin-Project: True Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Domain-Id: default Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Domain-Name: Default Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Name: admin Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Role: admin,member,reader Aug 22 12:40:26.619441 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Roles: admin,member,reader Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2da9e1885c75493abe2144dd979376b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2da9e1885c75493abe2144dd979376b4"}]}] Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Tenant: admin Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Tenant-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Tenant-Name: admin Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User: admin Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Domain-Id: default Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Domain-Name: Default Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Id: eb451a0ed5164dd0a6301058cedf4d62 Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Name: admin Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: method: > Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: exception: Flavor 84 could not be found. Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: action_args: {'id': '84'} Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:40:26.620955 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:26.621846 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:26.622976 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-0503a731-6367-4544-9fc0-afe5cc5c2c33 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:40:26.623983 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-0503a731-6367-4544-9fc0-afe5cc5c2c33 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391113 Aug 22 12:40:26.623983 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 22 12:40:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:26.630404 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-a57b69e1-fda7-4978-b95c-ffe519439985 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:26.645056 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-a57b69e1-fda7-4978-b95c-ffe519439985 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018212 Aug 22 12:40:26.645565 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 22 12:40:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:40:26.654796 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-ff8fb735-c12a-41cb-b9ea-aeeb9dd819e4 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:26.669748 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-ff8fb735-c12a-41cb-b9ea-aeeb9dd819e4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018413 Aug 22 12:40:26.670270 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 22 12:40:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:40:26.679546 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-8af2a084-735b-4152-a0cf-65d12ffbfd2a admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:26.684736 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.wsgi [None req-8af2a084-735b-4152-a0cf-65d12ffbfd2a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-8af2a084-735b-4152-a0cf-65d12ffbfd2a admin admin] Request method failure captured: Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Accept: application/json Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Accept-Encoding: gzip, deflate Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Connection: keep-alive Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Content-Length: 0 Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Host: 10.222.0.15 Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Openstack-Api-Version: compute 2.90 Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Openstack-System-Scope: None Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: User-Agent: python-novaclient Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Auth-Token: gAAAAABjA3k5ZFJiev34gzG_epn1bM5geAvlEXKhVNr6Em9ofwTHHKtgNkNYp5cjv7CDf4sDpbxRZnfLnw6hLdeOHXSUNY8d6K9O1Hk1kZ7Y2MxO9yNQBU6AKkIOZiedhRSkrxLFhpQyzMlX6v4MBnFgj1YNMGBPzZOyTTHPrNVMrgC6PPTQ4-g Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Domain-Id: None Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Domain-Name: None Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Identity-Status: Confirmed Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Is-Admin-Project: True Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Domain-Id: default Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Domain-Name: Default Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Name: admin Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Role: admin,member,reader Aug 22 12:40:26.686229 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Roles: admin,member,reader Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2da9e1885c75493abe2144dd979376b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2da9e1885c75493abe2144dd979376b4"}]}] Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Tenant: admin Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Tenant-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Tenant-Name: admin Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User: admin Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Domain-Id: default Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Domain-Name: Default Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Id: eb451a0ed5164dd0a6301058cedf4d62 Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Name: admin Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: method: > Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: exception: Flavor 84 could not be found. Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: action_args: {'id': '84'} Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:40:26.687764 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:26.688793 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:26.690144 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-8af2a084-735b-4152-a0cf-65d12ffbfd2a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:40:26.691395 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-8af2a084-735b-4152-a0cf-65d12ffbfd2a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011441 Aug 22 12:40:26.691395 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 22 12:40:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 22 12:40:27.656158 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-ff8fb735-c12a-41cb-b9ea-aeeb9dd819e4 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:27.657267 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-ff8fb735-c12a-41cb-b9ea-aeeb9dd819e4 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 22 12:40:27.657657 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:40:28.175367 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-0f368990-9f7a-423b-b003-235378b1b65a admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:28.181169 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.wsgi [None req-0f368990-9f7a-423b-b003-235378b1b65a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-0f368990-9f7a-423b-b003-235378b1b65a admin admin] Request method failure captured: Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Accept: application/json Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Accept-Encoding: gzip, deflate Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Connection: keep-alive Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Content-Length: 0 Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Host: 10.222.0.15 Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Openstack-Api-Version: compute 2.90 Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Openstack-System-Scope: None Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: User-Agent: python-novaclient Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Auth-Token: gAAAAABjA3k7kSK7WmmnXwmF38dFTiJVqO6uNuCRY4tUPppdKq0RCEE9-CIF9i2EoaoFXsrJ8tEE3rar4Ueylko17daefajWtwU4dcdYYBWQv-Eom33tjY22MDPZd_6UETS8Rk46bQX6_O1lzSb7R6N7PTgicc5UMk58M8FJdi00reP0iiEQjpg Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Domain-Id: None Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Domain-Name: None Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Identity-Status: Confirmed Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Is-Admin-Project: True Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Domain-Id: default Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Domain-Name: Default Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Project-Name: admin Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Role: admin,member,reader Aug 22 12:40:28.182696 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Roles: admin,member,reader Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2da9e1885c75493abe2144dd979376b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2da9e1885c75493abe2144dd979376b4"}]}] Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Tenant: admin Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Tenant-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-Tenant-Name: admin Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User: admin Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Domain-Id: default Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Domain-Name: Default Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Id: eb451a0ed5164dd0a6301058cedf4d62 Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: X-User-Name: admin Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: method: > Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: exception: Flavor 451 could not be found. Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: action_args: {'id': '451'} Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:40:28.184245 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:28.186125 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: ERROR nova.api.openstack.wsgi Aug 22 12:40:28.187506 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-0f368990-9f7a-423b-b003-235378b1b65a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:40:28.189093 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-0f368990-9f7a-423b-b003-235378b1b65a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389470 Aug 22 12:40:28.189093 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 22 12:40:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:28.194145 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-ae50357c-6595-4694-a046-9678bef63703 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:28.209224 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-ae50357c-6595-4694-a046-9678bef63703 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018656 Aug 22 12:40:28.209732 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 22 12:40:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:40:28.218858 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:28.233718 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018353 Aug 22 12:40:28.234250 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 22 12:40:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:40:28.243163 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-52a0fa18-4525-48ee-8e29-6c1ff4b7238a admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:28.248279 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.wsgi [None req-52a0fa18-4525-48ee-8e29-6c1ff4b7238a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-52a0fa18-4525-48ee-8e29-6c1ff4b7238a admin admin] Request method failure captured: Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Accept: application/json Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Accept-Encoding: gzip, deflate Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Connection: keep-alive Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Content-Length: 0 Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Host: 10.222.0.15 Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Openstack-Api-Version: compute 2.90 Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Openstack-System-Scope: None Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: User-Agent: python-novaclient Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Auth-Token: gAAAAABjA3k7kSK7WmmnXwmF38dFTiJVqO6uNuCRY4tUPppdKq0RCEE9-CIF9i2EoaoFXsrJ8tEE3rar4Ueylko17daefajWtwU4dcdYYBWQv-Eom33tjY22MDPZd_6UETS8Rk46bQX6_O1lzSb7R6N7PTgicc5UMk58M8FJdi00reP0iiEQjpg Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Domain-Id: None Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Domain-Name: None Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Identity-Status: Confirmed Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Is-Admin-Project: True Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Domain-Id: default Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Domain-Name: Default Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Project-Name: admin Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Role: admin,member,reader Aug 22 12:40:28.249739 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Roles: admin,member,reader Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2da9e1885c75493abe2144dd979376b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2da9e1885c75493abe2144dd979376b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2da9e1885c75493abe2144dd979376b4"}]}] Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Tenant: admin Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Tenant-Id: 2da9e1885c75493abe2144dd979376b4 Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-Tenant-Name: admin Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User: admin Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Domain-Id: default Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Domain-Name: Default Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Id: eb451a0ed5164dd0a6301058cedf4d62 Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: X-User-Name: admin Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: method: > Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: exception: Flavor 451 could not be found. Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: action_args: {'id': '451'} Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:40:28.251766 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:28.252899 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: ERROR nova.api.openstack.wsgi Aug 22 12:40:28.254319 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-52a0fa18-4525-48ee-8e29-6c1ff4b7238a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:40:28.255549 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-52a0fa18-4525-48ee-8e29-6c1ff4b7238a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011495 Aug 22 12:40:28.255549 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 22 12:40:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:29.216104 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:29.217129 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 22 12:40:29.217543 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:40:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:40:29.739006 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-4f0d5dda-4bb7-47d5-bd3a-a24337f8475b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:40:29.825294 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-4f0d5dda-4bb7-47d5-bd3a-a24337f8475b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.466191 Aug 22 12:40:29.825772 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 22 12:40:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:40:30.791783 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:30.792789 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 22 12:40:30.793178 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:40:31.318894 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-ee3f50f7-630e-4f2b-9f46-584ae74e60ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:40:31.402789 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-ee3f50f7-630e-4f2b-9f46-584ae74e60ff admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.472497 Aug 22 12:40:31.403326 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 22 12:40:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:40:32.399565 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:32.399565 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 22 12:40:32.399565 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:40:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:40:32.910117 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-c172e9f4-0268-4035-a890-258ef07242ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:40:33.009799 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-c172e9f4-0268-4035-a890-258ef07242ae admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.481744 Aug 22 12:40:33.010375 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 22 12:40:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:40:33.973930 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:33.974963 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 22 12:40:33.975353 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:40:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:40:34.490693 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-de0c2732-1d12-4ed8-bf8a-9ec406151363 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:40:34.563265 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-de0c2732-1d12-4ed8-bf8a-9ec406151363 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.449207 Aug 22 12:40:34.563815 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 22 12:40:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:40:35.523100 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:35.524096 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 22 12:40:35.524485 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:40:36.037968 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-7cec8dbe-acfa-4608-a9f5-8ff5d791c6f8 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:40:36.057843 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-7cec8dbe-acfa-4608-a9f5-8ff5d791c6f8 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.395827 Aug 22 12:40:36.058396 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Mon Aug 22 12:40:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:41:29.044418 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:41:29.045424 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-60a0dfca-33e4-4cba-abc9-d6c2d5acc2ec admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 22 12:41:29.045826 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 22 12:41:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:41:29.056209 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:29.432929 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-07cb5557-0f80-4dab-bfb9-66fc47265a0d admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:41:29.453803 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-07cb5557-0f80-4dab-bfb9-66fc47265a0d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402061 Aug 22 12:41:29.454370 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 22 12:41:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:41:29.475370 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG dbcounter [-] [112663] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:29.479174 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-3f62a50f-ea7a-470c-9b12-9e2ca4dd8803 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:41:29.487155 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-3f62a50f-ea7a-470c-9b12-9e2ca4dd8803 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013243 Aug 22 12:41:29.487655 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Aug 22 12:41:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:41:29.499213 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-870c3797-22b0-4e17-8236-d48b1864b189 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:41:29.507220 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-870c3797-22b0-4e17-8236-d48b1864b189 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011647 Aug 22 12:41:29.507732 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Aug 22 12:41:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:41:29.519446 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-cce8b0a3-f5d1-4f1e-8c25-3470b3b4e751 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:41:29.526985 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-cce8b0a3-f5d1-4f1e-8c25-3470b3b4e751 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011333 Aug 22 12:41:29.527492 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Aug 22 12:41:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:41:29.539122 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-1d257cfa-c913-4957-8ce1-a4973c8245ff admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:41:29.546614 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-1d257cfa-c913-4957-8ce1-a4973c8245ff admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010993 Aug 22 12:41:29.547117 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Aug 22 12:41:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:44:57.482159 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-cce8b0a3-f5d1-4f1e-8c25-3470b3b4e751 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:44:57.483194 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-cce8b0a3-f5d1-4f1e-8c25-3470b3b4e751 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 22 12:44:57.483728 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:44:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:44:57.624330 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writing DB stats nova_api:SELECT=6 {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:44:57.764404 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-6e6d9812-e188-44d3-9c1f-233b87ad44ad admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:44:57.766833 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:44:57.766833 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: warnings.warn(msg) Aug 22 12:44:57.767942 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-6e6d9812-e188-44d3-9c1f-233b87ad44ad admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:44:57.768405 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-6e6d9812-e188-44d3-9c1f-233b87ad44ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:44:57.768823 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-6e6d9812-e188-44d3-9c1f-233b87ad44ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:44:57.769527 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-6e6d9812-e188-44d3-9c1f-233b87ad44ad admin admin] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:44:57.769964 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-6e6d9812-e188-44d3-9c1f-233b87ad44ad admin admin] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:44:57.770397 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-6e6d9812-e188-44d3-9c1f-233b87ad44ad admin admin] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:44:57.802823 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-6e6d9812-e188-44d3-9c1f-233b87ad44ad admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.179972 Aug 22 12:44:57.803376 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 22 12:44:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:44:58.634832 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-cce8b0a3-f5d1-4f1e-8c25-3470b3b4e751 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:44:58.635867 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-cce8b0a3-f5d1-4f1e-8c25-3470b3b4e751 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 22 12:44:58.636266 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:44:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:44:58.825392 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-5819e139-d426-4947-8aaa-9e70dc8498ad admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:44:58.827638 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:44:58.827638 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: warnings.warn(msg) Aug 22 12:44:58.828747 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-5819e139-d426-4947-8aaa-9e70dc8498ad admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:44:58.829280 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-5819e139-d426-4947-8aaa-9e70dc8498ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:44:58.829711 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-5819e139-d426-4947-8aaa-9e70dc8498ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:44:58.830461 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-5819e139-d426-4947-8aaa-9e70dc8498ad admin admin] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:44:58.830912 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-5819e139-d426-4947-8aaa-9e70dc8498ad admin admin] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:44:58.831327 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-5819e139-d426-4947-8aaa-9e70dc8498ad admin admin] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:44:58.851083 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-5819e139-d426-4947-8aaa-9e70dc8498ad admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075818 Aug 22 12:44:58.851819 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 22 12:44:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:45:10.116069 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-cce8b0a3-f5d1-4f1e-8c25-3470b3b4e751 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:45:10.117088 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-cce8b0a3-f5d1-4f1e-8c25-3470b3b4e751 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Aug 22 12:45:10.117457 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:45:10.260665 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writing DB stats nova_cell0:SELECT=4 {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:45:10.261437 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writing DB stats nova_cell1:SELECT=4 {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:45:10.262270 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG dbcounter [-] [112664] Writing DB stats nova_api:SELECT=8 {{(pid=112664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:45:10.312505 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-26b97d0a-b030-40dd-8af6-4b06dcc2b410 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:45:10.314992 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:45:10.314992 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: warnings.warn(msg) Aug 22 12:45:10.316099 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-26b97d0a-b030-40dd-8af6-4b06dcc2b410 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:45:10.316570 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-26b97d0a-b030-40dd-8af6-4b06dcc2b410 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:45:10.316998 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-26b97d0a-b030-40dd-8af6-4b06dcc2b410 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:45:10.317716 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-26b97d0a-b030-40dd-8af6-4b06dcc2b410 admin admin] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:45:10.318160 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-26b97d0a-b030-40dd-8af6-4b06dcc2b410 admin admin] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:45:10.318599 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-26b97d0a-b030-40dd-8af6-4b06dcc2b410 admin admin] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:45:10.343463 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-26b97d0a-b030-40dd-8af6-4b06dcc2b410 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087104 Aug 22 12:45:10.343920 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 22 12:45:10 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:45:11.183623 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: DEBUG nova.api.openstack.wsgi [None req-cce8b0a3-f5d1-4f1e-8c25-3470b3b4e751 admin admin] Calling method '>' {{(pid=112663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:45:11.185233 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: INFO nova.api.openstack.requestlog [None req-cce8b0a3-f5d1-4f1e-8c25-3470b3b4e751 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 22 12:45:11.185627 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: [pid: 112663|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 22 12:45:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:45:11.376340 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG nova.api.openstack.wsgi [None req-1be95dfd-8623-4ef1-8260-2e0452486384 admin admin] Calling method '>' {{(pid=112664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:45:11.378830 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:45:11.378830 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: warnings.warn(msg) Aug 22 12:45:11.379918 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-1be95dfd-8623-4ef1-8260-2e0452486384 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:45:11.380381 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-1be95dfd-8623-4ef1-8260-2e0452486384 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:45:11.380801 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-1be95dfd-8623-4ef1-8260-2e0452486384 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:45:11.381501 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-1be95dfd-8623-4ef1-8260-2e0452486384 admin admin] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:45:11.381935 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-1be95dfd-8623-4ef1-8260-2e0452486384 admin admin] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:45:11.382382 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: DEBUG oslo_concurrency.lockutils [None req-1be95dfd-8623-4ef1-8260-2e0452486384 admin admin] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:45:11.403566 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: INFO nova.api.openstack.requestlog [None req-1be95dfd-8623-4ef1-8260-2e0452486384 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080092 Aug 22 12:45:11.404043 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: [pid: 112664|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 22 12:45:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:46:07.163815 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: Mon Aug 22 12:46:07 2022 - graceful shutdown triggered... Aug 22 12:46:07.164326 dv-cinder-850836-6-iscsi devstack@n-api.service[112664]: Gracefully killing worker 2 (pid: 112664)... Aug 22 12:46:07.163943 dv-cinder-850836-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 22 12:46:07.165123 dv-cinder-850836-6-iscsi devstack@n-api.service[112663]: Gracefully killing worker 1 (pid: 112663)... Aug 22 12:46:08.164966 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: worker 1 buried after 1 seconds Aug 22 12:46:08.165493 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: worker 2 buried after 1 seconds Aug 22 12:46:08.165493 dv-cinder-850836-6-iscsi devstack@n-api.service[112662]: goodbye to uWSGI. Aug 22 12:46:08.166545 dv-cinder-850836-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 22 12:46:08.167130 dv-cinder-850836-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 22 12:46:08.169957 dv-cinder-850836-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 12:46:08.180408 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 12:46:08.183117 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 12:46:08 2022] *** Aug 22 12:46:08.183278 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 12:46:08.183416 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 12:46:08.183533 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: nodename: dv-cinder-850836-6-iscsi Aug 22 12:46:08.183662 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: machine: x86_64 Aug 22 12:46:08.183778 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: clock source: unix Aug 22 12:46:08.183903 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: pcre jit disabled Aug 22 12:46:08.184014 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: detected number of CPU cores: 4 Aug 22 12:46:08.184268 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: current working directory: / Aug 22 12:46:08.184268 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: detected binary path: /usr/bin/uwsgi-core Aug 22 12:46:08.184268 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: your processes number limit is 47680 Aug 22 12:46:08.184268 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: your memory page size is 4096 bytes Aug 22 12:46:08.184268 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: detected max file descriptor number: 2048 Aug 22 12:46:08.184268 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: lock engine: pthread robust mutexes Aug 22 12:46:08.184708 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: thunder lock: enabled Aug 22 12:46:08.184708 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 12:46:08.184708 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 12:46:08.224991 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: Python main interpreter initialized at 0x55787ddc49c0 Aug 22 12:46:08.224991 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: python threads support enabled Aug 22 12:46:08.224991 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: your server socket listen backlog is limited to 100 connections Aug 22 12:46:08.224991 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: your mercy for graceful operations on workers is 90 seconds Aug 22 12:46:08.225491 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 12:46:08.225491 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: *** Operational MODE: preforking *** Aug 22 12:46:08.225720 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: *** uWSGI is running in multiple interpreter mode *** Aug 22 12:46:08.225720 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: spawned uWSGI master process (pid: 127791) Aug 22 12:46:08.225926 dv-cinder-850836-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 12:46:08.230145 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: spawned uWSGI worker 1 (pid: 127809, cores: 1) Aug 22 12:46:08.230145 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: spawned uWSGI worker 2 (pid: 127810, cores: 1) Aug 22 12:46:08.230145 dv-cinder-850836-6-iscsi devstack@n-api.service[127791]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 12:46:08.890119 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 12:46:08.900315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 12:46:10.065306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:46:10.065306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: from cryptography.utils import int_from_bytes Aug 22 12:46:10.065974 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:46:10.065974 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: from cryptography.utils import int_from_bytes Aug 22 12:46:10.074830 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:46:10.074830 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: from cryptography.utils import int_from_bytes Aug 22 12:46:10.075337 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:46:10.075337 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: from cryptography.utils import int_from_bytes Aug 22 12:46:12.513484 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 12:46:12.514039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 12:46:12.514344 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 12:46:12.514585 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 12:46:12.514849 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 12:46:12.515243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.515579 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.515910 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.516240 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.517272 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.517598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.517931 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.518297 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.518639 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.518906 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.519232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.519564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-6-iscsi {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.519893 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.520210 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.520530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.520857 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.521176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.521506 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.521719 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 12:46:12.522099 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.522200 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 12:46:12.522382 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.522518 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 12:46:12.522887 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 12:46:12.523153 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 12:46:12.523616 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.523870 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.524071 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.524274 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.524476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.524689 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.524905 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.524905 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.525343 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.525564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.525778 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.525996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.526236 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.526455 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.526682 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.526898 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.527113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.527113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.527526 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.527741 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.527956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.528170 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-6-iscsi {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.528386 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-6-iscsi {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.528601 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.528811 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.529027 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.529214 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.529454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.529631 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.529794 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.529956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.530139 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.530326 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.530478 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.530634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.530810 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.530984 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.531139 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.531320 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.531507 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.531662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.531826 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.531973 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.532152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.532298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.532462 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.532616 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.532770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.532941 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.533098 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.533258 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.533415 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.533590 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.534865 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.535035 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.535181 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.535333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.535496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.535647 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.535799 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-6-iscsi {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.535953 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.536103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.536259 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.536419 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.536570 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.536722 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.536875 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.536875 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.537297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.537456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.537610 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.537762 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.537917 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.538068 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.538255 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.538425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.539142 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.539914 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.540077 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.540235 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.540658 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.540821 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.540965 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.541107 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.541260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.541427 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.541617 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.541782 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.541936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.542086 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.542302 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.542449 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.542603 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.542756 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.542905 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.543053 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.543202 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.543351 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.543516 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.543669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.543834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.544309 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.544468 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.544639 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.545086 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.545238 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.545389 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.545542 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.545694 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.545848 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.546021 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.546021 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.546337 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.546488 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.546631 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.546784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.546934 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.547104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.547448 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.547656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.547811 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.547974 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.548148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.548290 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.548439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.548580 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.548745 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.548921 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.549077 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.549229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.549378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.549528 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.549679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.549843 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.550070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.550344 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.550553 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.550763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.550991 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.551204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.551732 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.551950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.552158 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.552356 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.552564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.552966 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.553180 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.553388 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.553628 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.553875 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.554554 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.554728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.554937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.555125 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.555601 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.555713 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.555808 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.555892 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.555982 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.556065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.556154 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.556253 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.556362 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.556517 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.556674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.556674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.556927 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.557101 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.557263 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.557665 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.557923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.557923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.558144 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.558267 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.558361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.558451 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.558535 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.558623 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.558718 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.558801 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.558890 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.558988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.559080 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.559170 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.559264 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.559347 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.559433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.559524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.559614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.559705 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.559787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.559868 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.559949 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560041 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560125 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560302 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560384 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560472 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560563 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560654 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560737 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.560995 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.561085 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.561174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.561256 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.561337 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.561480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.561617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.561801 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.561900 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.561990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.562081 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.562270 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.562371 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.562456 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.562537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.562627 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.562712 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.562801 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.562884 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.562966 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.563047 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.563684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.563786 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.563878 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.563968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.564058 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.564147 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.564242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.564345 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.564590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.564695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.564790 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.564790 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.564954 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.565041 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.565180 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.565274 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.565357 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.565451 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.565541 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.565698 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.565829 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.565924 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.566007 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.566102 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.566201 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.566331 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.566430 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.566515 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.566597 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.566687 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.566776 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.566865 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.566957 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.567045 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.567134 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.567225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.567315 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.567403 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.567403 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.567561 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.567735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.567831 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.567923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.568007 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.568096 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:46:12.568186 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.568286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.568370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.568451 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.568540 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.568630 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.568714 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.568809 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.568899 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.568990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.569083 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.569167 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.569323 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.569425 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.569521 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.569611 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.569700 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.569791 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.569881 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.569964 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.570055 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.570146 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.570392 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.570392 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.570579 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.570738 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.570838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.570924 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.571005 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.571087 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.571176 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.571270 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.571354 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.571442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.571525 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.571614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.571696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.571805 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.571896 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.572039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.572141 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.572359 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.572457 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.572679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.572776 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.573002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.573115 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.573326 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.573482 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.573673 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.573786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.574000 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.574103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.574347 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.574482 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.574677 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.574786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.575005 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.575115 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.575344 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.575488 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.575639 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.575763 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.575957 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.576287 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.576780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.577095 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.577441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.577762 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.578092 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.578442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.580018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.580130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.580130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.580286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.580366 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.580444 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.580525 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.580598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.580675 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.580752 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.580932 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.581029 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.581191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.581545 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.581618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.581820 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.581969 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.582140 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.582311 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.582484 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.582645 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.582802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.582977 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.583110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.583636 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.583741 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.583824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.583907 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.583994 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.584073 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.584279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.584382 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.584627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.584736 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.584941 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.585065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.585308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.585417 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.585590 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.585691 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.585900 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.586004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.586254 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.586354 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.586558 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.586653 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.586876 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.586979 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.587190 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.587295 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.587512 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.587614 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.587828 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.587921 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.588140 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.588245 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.588471 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.588576 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.588787 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.588880 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.589102 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.589195 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.589431 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.589535 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.589744 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.589845 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.590055 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.590156 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.590400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.590501 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.590717 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.590812 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.591036 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.591130 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.591355 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.591448 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.591669 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.591762 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.592006 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.592103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.592291 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.592385 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.592602 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.592695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.592911 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.593003 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.593224 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.593315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.593543 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.593638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.593856 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.593963 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.594168 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.594296 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.594547 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.594649 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.594858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.594966 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.595174 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.595308 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.595480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.595575 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.595791 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.595894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.596101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.596202 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.596411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.596517 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.596718 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.596912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.597051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.597188 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.597327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.597465 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.597602 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.597732 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.597902 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.598043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.598251 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.598412 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.598563 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.598738 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.598878 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.599062 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.599203 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.599386 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.599534 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.599709 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.599843 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.600041 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.600182 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.600365 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.600513 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.600699 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.600840 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.601024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.601164 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.601349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.601494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.601667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.601801 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.601993 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.602162 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.602414 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.602546 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.602677 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.602804 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.602932 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.603317 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.603502 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.603638 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.603834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.603966 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.604151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.604284 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.604476 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.604618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.604792 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.604932 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.605111 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.605242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.605423 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.605554 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.605740 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.605872 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.606047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.606215 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.606406 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.606600 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.606748 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.606880 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.607010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.607148 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.607327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.607461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.607660 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.607803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.607977 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.608118 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.608298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.608423 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.608608 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.608747 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.608921 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.609062 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.609237 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.609378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.609551 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.609691 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.609874 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.610681 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.610883 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.611029 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.611167 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.611304 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.611437 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.611574 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.611711 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.611830 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.611966 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.612110 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.612287 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.612419 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.612555 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.612686 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.612853 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.612996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.613174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.613306 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.613496 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.613637 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.613807 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.613946 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.614126 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.614287 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.614480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.614663 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.614825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.614998 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.615131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.615268 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.615406 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.615544 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.615711 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.615853 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.616020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.616153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.616335 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.616476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.616658 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.616792 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.616975 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.617079 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.617285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.617394 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.617592 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.617702 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.617913 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.618068 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.618239 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.618388 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.618543 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.618700 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.618839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.618927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.619144 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.619236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.619471 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.619564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.619790 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.619888 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.620099 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.620195 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.620425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.620523 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.620731 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.620821 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.621040 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.621138 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.621368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.621485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.621685 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.621805 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.621996 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.622098 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.622329 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.622432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.622639 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.622743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.622975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.623080 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.623290 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.623390 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.623600 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.623693 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.623915 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.624014 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.624241 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.624334 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.624555 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.624654 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.624874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.624979 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.625189 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.625300 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.625505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.625687 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.625866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.626000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.626242 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.626393 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.626525 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.626656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.626886 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.627589 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.627756 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.627756 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.628021 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.628152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.628296 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.628434 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.628564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.628709 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.628981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.629131 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.629264 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.629401 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.629532 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.629670 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.629810 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.629949 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.630087 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.630265 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.630425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.630425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.630691 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.630823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.630953 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.631082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.631219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.631421 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.631554 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.631691 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.631828 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.631960 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.632098 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.632229 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.632400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.632533 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.632669 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.632803 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.633015 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.633151 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.633331 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.633447 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.633641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.633742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.633951 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.634051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.634291 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.634403 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.634611 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.634710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.634921 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.635014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.635238 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.635416 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.635576 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.635729 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.635874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.636006 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.636138 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.636281 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.636441 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.636577 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.636744 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.636898 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.637107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.637322 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.637463 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.637600 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.637739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.637877 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.638016 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.638147 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.638309 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.638450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.638596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.638730 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.638912 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.639070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.639224 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.639359 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.639538 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.639671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.639847 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.639982 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.640193 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.640329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.640503 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.640638 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.640812 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.640945 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.641131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.641778 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.641975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.642124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.642321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.642509 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.642652 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.642790 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.642927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.643067 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.643244 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.643385 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.643551 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.643690 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.643863 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.644006 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.644177 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.644308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.644490 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.644621 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.644801 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.644933 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.645114 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.645254 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.645440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.645567 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.645789 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.645920 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.646042 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.646154 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.652512 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.652635 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.652743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.652833 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.652918 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653001 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653085 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653168 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653265 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653350 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653615 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653698 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653789 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653875 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.653964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654049 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654049 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654245 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654245 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654401 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654401 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654729 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654729 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654890 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.654988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.655073 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.655155 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.655246 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.655346 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.655577 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.655696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.655796 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.656117 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.656213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.656305 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.656390 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.656390 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.656542 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.656633 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.656724 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.656815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.656906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.657622 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.657770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.657915 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.658004 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.658095 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.658201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.658288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.658370 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.658470 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.658563 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.658655 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.658745 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.658829 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.658918 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.659014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.659105 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.659190 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.659343 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.659436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.659534 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.659618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.659701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.659783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.659873 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.659957 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660052 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660136 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660315 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660661 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.660991 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.661082 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.661166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.661248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.661330 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.661412 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.661502 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.661586 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.661670 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.661758 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.661842 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.661923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.662018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.662102 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.662211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.662297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.662391 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.662491 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.662590 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.662708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.662843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.663027 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.663140 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.663344 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.663508 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.663671 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.663860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.664012 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.664203 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.664378 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.664530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.664671 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.664813 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.664960 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.665101 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.665250 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.665398 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.665547 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.665709 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.665878 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.666035 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.666307 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.666460 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.666606 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.666749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.666907 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.667053 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.667278 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.667439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.667586 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.667836 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.668006 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.668166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.668311 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.668463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.668609 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.668752 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.668896 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.669047 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.669192 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.669342 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.669513 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.669660 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.669821 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.669975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.670127 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.670299 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.670445 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.670561 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.670561 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.670832 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.670923 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.671010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.671140 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.671258 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.671460 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.671560 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.671769 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.671869 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.672094 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.672192 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.672406 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.672497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.672741 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.672854 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.673058 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.673170 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.673366 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.673466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.673675 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.673774 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.674021 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.674111 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.674438 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.682351 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.682464 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.682552 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.682636 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.682728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.682873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.682970 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.683080 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.683207 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.683298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.683392 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.683392 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.683559 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.683559 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.683711 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.683793 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.683884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.683975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684058 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684141 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684222 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684311 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684403 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684495 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684578 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684578 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684728 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684822 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684913 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.684996 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.685078 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.685160 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.685242 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.685332 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.685423 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.685512 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.685596 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.685685 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.685775 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.685912 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.686012 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.686174 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.686411 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.686514 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.686607 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.686700 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.686785 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.686867 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.686958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.687042 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.687133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.687133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.687293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.687383 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.687481 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.687577 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.687676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.687762 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.688009 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.688141 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.688242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.688341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.688433 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.688518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.688600 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.688682 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.688777 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.688777 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.688961 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.689101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.689197 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.689282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.689382 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.689466 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.689557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.689665 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.689797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.689897 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.689994 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.690079 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.690169 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.690274 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.690357 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.690357 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.690529 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.690618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.690708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.690792 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.690874 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.691075 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.691178 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.691264 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.691347 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.691436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.691520 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.691616 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.691701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.691784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.691874 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.691965 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.692056 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.692148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.692239 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.692322 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.692410 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.692501 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.692641 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.692734 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.692817 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.692955 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.693043 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.693133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.693235 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.693364 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.693456 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.693539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.693629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.693712 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.693856 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.693945 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.694028 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.694157 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.694278 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.694381 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.694476 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.694560 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.694649 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.694740 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.694836 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.694982 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.695090 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.695320 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.695414 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.695627 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.695719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.695956 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.696051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.696272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.696415 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.696588 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.696688 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.696889 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.696972 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.697198 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.697291 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.697548 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.697647 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.697856 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.697955 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.698172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.698297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.698513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.698617 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.698873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.699011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.699195 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.699287 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.699510 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.699611 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.699830 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.699967 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.700143 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.700243 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.700456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.700561 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.700768 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.700860 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.701075 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.701209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.701385 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.701490 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.701700 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.701791 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.702009 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.702104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.702344 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.702439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.702655 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.702746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.702964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.703054 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.703268 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.703361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.703574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.703677 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.704411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.704512 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.704737 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.704830 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.705088 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.705181 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.705421 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.705521 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.705735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.705841 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.706044 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.706136 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.706397 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.706544 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.706712 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.706851 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.707047 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.707169 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.707356 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.707496 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.707674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.707799 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.707990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.708084 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.708313 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.708425 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.708630 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.708729 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.708952 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.709170 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.709271 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.709512 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.709605 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.709838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.709930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.710163 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.710325 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.710535 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.710661 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.710867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.710965 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.711191 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.711343 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.711508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.711608 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.711827 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.711918 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.712148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.712354 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.712470 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.712685 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.712807 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.713002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.713138 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.713319 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.713472 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.713633 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.713818 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.713950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.714149 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.714304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.714501 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.714604 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.714829 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.714922 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.715161 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.715266 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.715499 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.715590 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.715830 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.715930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.716147 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.716240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.716471 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.716605 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.716799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.716943 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.717122 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.717235 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.717439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.717543 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.717755 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.717873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.718072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.718205 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.718420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.718529 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.718782 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.718891 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.719065 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.719217 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.719406 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.720095 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.720259 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.720420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.720594 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.720740 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.720936 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.721043 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.721269 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.721405 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.721593 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.721763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.721917 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.722123 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.722324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.722473 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.722794 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.722915 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.723115 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.723247 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.723435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.723527 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.723764 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.723855 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.724101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.724202 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.724424 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.724516 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.724748 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.724846 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.725068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.725159 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.725388 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.725486 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.725699 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.725915 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.726015 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.726257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.726353 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.726594 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.726734 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.726969 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.727073 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.727286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.727378 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.727600 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.727699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.727919 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.728277 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.728492 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.728609 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.728802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.729103 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.729210 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.729418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.729510 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.729771 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.729870 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.730080 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.730208 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.730435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.733951 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.734097 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.734207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.734306 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.734401 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.734492 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.734576 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.734666 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.734755 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.734755 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.734929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735193 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735283 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735374 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735374 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735540 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735630 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735720 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735811 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.735997 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.736076 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.736154 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.736226 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.736302 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.736386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.736458 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.736528 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.736604 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.737240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.737319 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.737390 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.737468 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.737540 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.737610 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.737688 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.737760 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.737831 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.737900 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.737977 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738048 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738252 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738329 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738400 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738470 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738560 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738646 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738797 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.738944 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.739029 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.739101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.739535 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.739661 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.739909 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.740037 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.740155 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.740266 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.740509 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.740629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.740876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.741011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.741109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.741193 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.741288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.741373 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.741500 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.741638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.741821 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.741913 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.742136 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.742260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.742469 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.742568 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.742784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.742884 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.743093 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.743186 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.743420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.743658 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.743751 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.744000 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.744220 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.744320 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.744547 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.744639 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.744866 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.744970 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.745197 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.745296 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.745520 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.745612 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.745838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.746027 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.746203 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.746310 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.746532 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.746632 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.746851 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.747071 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.747203 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.747416 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.747510 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.747742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.747842 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.748076 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.748175 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.748395 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.748488 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.748709 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.748887 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.749020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.749113 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.749336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.749476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.749652 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.749772 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.749968 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.750085 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.750310 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.750431 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.750656 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.750804 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.750999 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.751108 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.751347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.751455 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.751663 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.751816 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.751984 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.752089 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.752301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.752394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.752618 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.752712 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.752937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.753041 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.753249 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.753369 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.753562 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.753678 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.753872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.753976 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.754201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.754318 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.754521 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.754627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.754854 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.754955 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.755174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.755291 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.755496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.755599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.755815 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.755920 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.756135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.756257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.756450 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.756573 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.756763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.756881 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.757081 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.757191 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.757395 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.757504 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.757725 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.757835 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.758048 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.758144 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.758394 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.758489 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.758708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.758850 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.759058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.759151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.759410 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.759547 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.759723 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.759827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.760039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.760139 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.760350 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.760442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.760662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.760776 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.760982 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.761104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.761293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.761395 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.761607 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.761720 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.761928 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.762037 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.762243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.762348 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.762564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.762684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.762875 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.762978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.763189 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.763304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.763588 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.763707 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.763798 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.763892 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.764100 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.764212 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.764407 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.764510 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.764718 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.764829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.765026 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.765136 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.765332 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.765436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.765640 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.765751 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.765948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.766050 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.766794 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.767108 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.767391 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.767495 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.767712 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.767824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.768024 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.768123 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.768329 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.768428 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.768635 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.768747 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.768983 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.769085 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.769239 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.769333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.769578 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.769691 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.769839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.769940 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.770146 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.770285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.770475 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.770587 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.770783 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.770881 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.771088 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.771194 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.771481 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.771579 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.771794 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.771892 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.772116 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.772216 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.772432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.772587 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.772758 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.772908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.773082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.773240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.773396 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.773541 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.773734 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.773891 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.774036 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.774211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.774388 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.774544 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.774701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.774853 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.774998 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.775150 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.775296 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.775440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.775586 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.775730 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.775884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.776037 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.776192 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.776345 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.776490 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.776646 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.776800 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.776955 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.777109 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.777254 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.777398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.777569 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.777726 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.777871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.778024 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.778286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.778443 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.778589 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.778814 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.778986 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.779146 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.779293 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.779439 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.779595 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.779777 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.779931 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.780077 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.780245 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.780400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.780560 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.780706 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.780851 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.781003 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.781156 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.781331 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.781495 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.781641 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.781784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.781976 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.782654 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.782798 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.782947 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.783093 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.783236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.783377 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.783526 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.783681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.783862 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.784007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.784148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.784296 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.784438 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.784608 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.784764 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.784911 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.785063 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.785216 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.785370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 12:46:12.785530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.785682 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.786003 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.786377 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.786711 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.787029 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.787344 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.787655 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:46:12.787900 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 12:46:12.846286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO dbcounter [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Registered counter for database nova_api Aug 22 12:46:12.848502 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO dbcounter [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Registered counter for database nova_api Aug 22 12:46:12.867122 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_db.sqlalchemy.engines [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:46:12.868725 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_db.sqlalchemy.engines [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:46:12.874120 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writer thread running {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:46:12.875496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writer thread running {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:46:12.930454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.context [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9cc14116-d0bf-4920-ba82-d0258dbf20da(cell1) {{(pid=127810) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 12:46:12.932184 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.context [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9cc14116-d0bf-4920-ba82-d0258dbf20da(cell1) {{(pid=127809) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 12:46:12.934499 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:46:12.934976 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:46:12.936438 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:46:12.936621 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:46:12.937051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:46:12.937266 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:46:12.937717 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:46:12.939400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:46:12.940215 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:46:12.940324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:46:12.940812 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:46:12.942234 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO dbcounter [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Registered counter for database nova_cell0 Aug 22 12:46:12.942965 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:46:12.945025 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO dbcounter [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Registered counter for database nova_cell0 Aug 22 12:46:12.946404 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO dbcounter [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Registered counter for database nova_cell1 Aug 22 12:46:12.949269 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO dbcounter [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Registered counter for database nova_cell1 Aug 22 12:46:12.955074 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_db.sqlalchemy.engines [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:46:12.955803 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_db.sqlalchemy.engines [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:46:12.957742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_db.sqlalchemy.engines [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:46:12.960789 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writer thread running {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:46:12.961755 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_db.sqlalchemy.engines [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:46:12.969414 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writer thread running {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:46:12.969746 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writer thread running {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:46:13.102663 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writer thread running {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:46:13.112010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO dbcounter [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Registered counter for database nova_cell0 Aug 22 12:46:13.116646 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO dbcounter [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Registered counter for database nova_cell0 Aug 22 12:46:13.118935 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_db.sqlalchemy.engines [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:46:13.123582 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writer thread running {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:46:13.126880 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_db.sqlalchemy.engines [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:46:13.131274 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writer thread running {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:46:13.451803 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: WARNING keystonemiddleware.auth_token [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 12:46:13.458534 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: WARNING keystonemiddleware.auth_token [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 12:46:13.459509 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: WARNING keystonemiddleware.auth_token [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 12:46:13.465732 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: WARNING keystonemiddleware.auth_token [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 12:46:13.805354 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: WARNING keystonemiddleware.auth_token [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 12:46:13.811421 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: WARNING keystonemiddleware.auth_token [None req-f0329e67-8821-4b44-acb7-dee1d9572689 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 12:46:13.816700 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: WARNING keystonemiddleware.auth_token [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 12:46:13.817281 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55787ddc49c0 pid: 127810 (default app) Aug 22 12:46:13.822810 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: WARNING keystonemiddleware.auth_token [None req-fa68c15e-ed02-4373-b72a-d8d43e444316 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 12:46:13.828234 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55787ddc49c0 pid: 127809 (default app) Aug 22 12:46:49.071182 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=3 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:49.072358 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=3 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:49.073188 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=3 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:49.073919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=3 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:50.314634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ef1fa65e-9a33-4367-b484-8ba4d345d1c5 tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] Action: 'create', calling method: .version_select at 0x7f765bd5d5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-351154383", "metadata": {"Type": "work"}}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:46:50.672027 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=3 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:50.677504 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=3 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:50.677504 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=3 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:50.677504 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=3 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:51.549480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a6b7ae40-d3bb-4224-921c-36dcb9e3d44e tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Action: 'create', calling method: .version_select at 0x7f765bd5d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-100425681"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:46:52.253504 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ef1fa65e-9a33-4367-b484-8ba4d345d1c5 tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.206741 Aug 22 12:46:52.254311 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 22 12:46:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3210 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 22 12:46:52.268093 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-244c7ff8-42c4-47bd-abd9-c4d0a9173b21 tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] Calling method '.version_select at 0x7f765bc324c0>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:52.366060 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-244c7ff8-42c4-47bd-abd9-c4d0a9173b21 tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff" status: 200 len: 352 microversion: 2.1 time: 0.102481 Aug 22 12:46:52.375938 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 2/2] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:46:52 2022] GET /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:52.527462 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e10d9550-1bd7-460b-b27b-330cec05126d tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] Calling method '.version_select at 0x7f765bc32b80>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:52.896016 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e10d9550-1bd7-460b-b27b-330cec05126d tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/792df932-e86c-46b9-b4a7-438b8c2df2cb" status: 200 len: 350 microversion: 2.1 time: 0.374148 Aug 22 12:46:52.896673 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 3/3] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:46:52 2022] GET /compute/v2.1/os-volumes/792df932-e86c-46b9-b4a7-438b8c2df2cb => generated 350 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:46:52.952283 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a6b7ae40-d3bb-4224-921c-36dcb9e3d44e tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.286486 Aug 22 12:46:52.954504 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 1/4] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Aug 22 12:46:50 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2292 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 22 12:46:52.969457 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-873b3e5e-b2b0-4703-bb35-576fcce90aed tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bc4c310>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:53.395227 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-455a8f8b-2837-4367-8330-233df5c76325 tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] Calling method '.version_select at 0x7f765bc324c0>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:53.633574 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-873b3e5e-b2b0-4703-bb35-576fcce90aed tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c" status: 200 len: 344 microversion: 2.1 time: 0.663540 Aug 22 12:46:53.634456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 4/5] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:46:52 2022] GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c => generated 344 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:53.679398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-455a8f8b-2837-4367-8330-233df5c76325 tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff" status: 200 len: 353 microversion: 2.1 time: 0.293189 Aug 22 12:46:53.680712 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 2/6] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:46:53 2022] GET /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff => generated 353 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:53.692438 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4f1b6391-f2ba-4ecb-baba-c231930d1221 tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] Calling method '.version_select at 0x7f765bc32a60>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:53.759629 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4f1b6391-f2ba-4ecb-baba-c231930d1221 tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff" status: 200 len: 353 microversion: 2.1 time: 0.070801 Aug 22 12:46:53.760459 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 5/7] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:46:53 2022] GET /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:53.805712 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bc88a61f-6ce2-4aa8-8aad-ee2c3525f4a6 tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] Calling method '.version_select at 0x7f765bc32c10>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:54.081609 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bc88a61f-6ce2-4aa8-8aad-ee2c3525f4a6 tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff" status: 202 len: 0 microversion: 2.1 time: 0.284751 Aug 22 12:46:54.082731 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 3/8] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 22 12:46:53 2022] DELETE /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:46:54.093513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c3a016b5-d1c1-415a-9d85-2b39c452abeb tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] Calling method '.version_select at 0x7f765bc323a0>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:54.435837 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c3a016b5-d1c1-415a-9d85-2b39c452abeb tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff" status: 200 len: 352 microversion: 2.1 time: 0.347985 Aug 22 12:46:54.436606 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 6/9] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:46:54 2022] GET /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff => generated 352 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:54.641402 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-77558a7a-e697-4c0f-a0e2-f7c846b9b9e0 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bc49310>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:54.751490 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-77558a7a-e697-4c0f-a0e2-f7c846b9b9e0 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c" status: 200 len: 345 microversion: 2.1 time: 0.113966 Aug 22 12:46:54.760486 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 4/10] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:46:54 2022] GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c => generated 345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:54.765872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-200321e6-c1f3-4671-90f7-7130c5337cb6 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Action: 'create', calling method: .version_select at 0x7f765bc4c4c0>, body: {"snapshot": {"volume_id": "8d427413-b62d-4a30-ad22-d975b11e2a3c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-302041318"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:46:55.449921 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-12708585-e352-4fe2-b8a0-3368af8edd8f tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] Calling method '.version_select at 0x7f765bc32c10>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:55.809248 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-200321e6-c1f3-4671-90f7-7130c5337cb6 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.048292 Aug 22 12:46:55.810261 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 7/11] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Aug 22 12:46:54 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:46:55.818207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-21a0edaa-29d5-4a4f-b3f5-ebdf393a1c6f tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] Calling method '.version_select at 0x7f765bc4cdc0>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:55.862106 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-12708585-e352-4fe2-b8a0-3368af8edd8f tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] HTTP exception thrown: Volume 1d37e25f-d17c-4fcc-9092-912abd2b0fff could not be found. Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-12708585-e352-4fe2-b8a0-3368af8edd8f tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] Request method failure captured: Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff HTTP/1.1 Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3q4YTWKag1YakBj10MlGBrEUPs--RMT3JuSinOJafO6P3wc313Myz79GtY_OmZJ-JSAzhOKDSmZmCq92r5xJ8DMTqLQ_KkhUmPot7GD1fgnb3gWxW8yHqvxMjHj72hThdxoPM4pwJH2YmeQzZkMP1EU6dVFhbUe43qNnBDwUJq90MA Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 8fff07d9bde345e2aad41598a71eef12 Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-VolumesGetTestJSON-711412221 Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:46:55.868647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8fff07d9bde345e2aad41598a71eef12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8fff07d9bde345e2aad41598a71eef12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8fff07d9bde345e2aad41598a71eef12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8fff07d9bde345e2aad41598a71eef12"}]}] Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-VolumesGetTestJSON-711412221 Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 8fff07d9bde345e2aad41598a71eef12 Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-VolumesGetTestJSON-711412221 Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-VolumesGetTestJSON-711412221-project Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 0925c914747e49e3b51bdb173ec6bae1 Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-VolumesGetTestJSON-711412221-project Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Volume 1d37e25f-d17c-4fcc-9092-912abd2b0fff could not be found. Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '1d37e25f-d17c-4fcc-9092-912abd2b0fff'} Aug 22 12:46:55.869838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d37e25f-d17c-4fcc-9092-912abd2b0fff could not be found. (HTTP 404) (Request-ID: req-8649b79c-9c86-4b4f-a216-a3ea3f1d478a) Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:46:55.870690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 12:46:55.871803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d37e25f-d17c-4fcc-9092-912abd2b0fff could not be found. Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 12:46:55.872906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d37e25f-d17c-4fcc-9092-912abd2b0fff could not be found. Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d37e25f-d17c-4fcc-9092-912abd2b0fff could not be found. Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-12708585-e352-4fe2-b8a0-3368af8edd8f tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] Returning 404 to user: Volume 1d37e25f-d17c-4fcc-9092-912abd2b0fff could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-12708585-e352-4fe2-b8a0-3368af8edd8f tempest-VolumesGetTestJSON-711412221 tempest-VolumesGetTestJSON-711412221-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff" status: 404 len: 109 microversion: 2.1 time: 0.424450 Aug 22 12:46:55.879750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 5/12] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:46:55 2022] GET /compute/v2.1/os-volumes/1d37e25f-d17c-4fcc-9092-912abd2b0fff => generated 109 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:46:55.890746 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-afa9686c-7e4f-446c-bffc-b0734dbc3ce1 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765c607b80>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:56.040493 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-21a0edaa-29d5-4a4f-b3f5-ebdf393a1c6f tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/65c60525-094f-4e41-af48-98f5b701e145" status: 200 len: 350 microversion: 2.1 time: 0.228706 Aug 22 12:46:56.044863 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 8/13] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:46:55 2022] GET /compute/v2.1/os-volumes/65c60525-094f-4e41-af48-98f5b701e145 => generated 350 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:56.130420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-afa9686c-7e4f-446c-bffc-b0734dbc3ce1 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae" status: 200 len: 286 microversion: 2.1 time: 0.257326 Aug 22 12:46:56.132189 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 6/14] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 22 12:46:55 2022] GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae => generated 286 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:56.153391 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6ec93899-2080-4abe-82fe-25fe871d4a69 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bc4c0d0>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:56.261463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6ec93899-2080-4abe-82fe-25fe871d4a69 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.121654 Aug 22 12:46:56.262500 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 9/15] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Aug 22 12:46:56 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:56.280542 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f0033562-63ef-4f4c-abd0-e0cba38f38be tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bc32d30>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:56.332134 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f0033562-63ef-4f4c-abd0-e0cba38f38be tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae" status: 200 len: 286 microversion: 2.1 time: 0.061344 Aug 22 12:46:56.333961 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 7/16] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 22 12:46:56 2022] GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:57.348094 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6be9817b-1ddb-4d61-bcc1-23eb2d29ee57 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bc32e50>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:57.441260 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6be9817b-1ddb-4d61-bcc1-23eb2d29ee57 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae" status: 200 len: 286 microversion: 2.1 time: 0.099199 Aug 22 12:46:57.446636 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 10/17] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 22 12:46:57 2022] GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:58.464637 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6559a1e8-ff99-446b-a6d8-6e4644966437 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bba74c0>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:58.524370 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6559a1e8-ff99-446b-a6d8-6e4644966437 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae" status: 200 len: 286 microversion: 2.1 time: 0.072078 Aug 22 12:46:58.526228 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 8/18] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 22 12:46:58 2022] GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:59.538367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-17bc4310-248e-4721-989a-be59c5eac158 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bc32820>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:59.609959 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-17bc4310-248e-4721-989a-be59c5eac158 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae" status: 200 len: 287 microversion: 2.1 time: 0.075712 Aug 22 12:46:59.611325 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 11/19] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 22 12:46:59 2022] GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:46:59.632088 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f1632cae-c5c9-4bed-bfed-124237eec7da tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bba7b80>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:46:59.944262 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f1632cae-c5c9-4bed-bfed-124237eec7da tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae" status: 202 len: 0 microversion: 2.1 time: 0.317936 Aug 22 12:46:59.944868 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 9/20] 10.222.0.15 () {58 vars in 1254 bytes} [Mon Aug 22 12:46:59 2022] DELETE /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:46:59.957446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-49c03c59-719b-4c78-810f-eb7aa7e339a5 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bc323a0>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:00.035035 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-49c03c59-719b-4c78-810f-eb7aa7e339a5 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae" status: 200 len: 286 microversion: 2.1 time: 0.085673 Aug 22 12:47:00.036947 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 12/21] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 22 12:46:59 2022] GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:00.382315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5f7ea322-10d2-4de0-b975-ae30d78e5e34 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] Calling method '.version_select at 0x7f765bba7c10>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:00.536692 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-5f7ea322-10d2-4de0-b975-ae30d78e5e34 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/0a57c831-e961-4517-bc1d-0f747f95c70e" status: 200 len: 350 microversion: 2.1 time: 0.161261 Aug 22 12:47:00.545004 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 10/22] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:47:00 2022] GET /compute/v2.1/os-volumes/0a57c831-e961-4517-bc1d-0f747f95c70e => generated 350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:00.551939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7f84011d-12bf-4dba-a7b7-aa7c06763fab tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] Calling method '.version_select at 0x7f765bc4c550>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:00.776095 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7f84011d-12bf-4dba-a7b7-aa7c06763fab tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.229198 Aug 22 12:47:00.776903 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 13/23] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Aug 22 12:47:00 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:00.792387 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-18083215-def0-49da-833e-379bbc4b6e32 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] Calling method '.version_select at 0x7f765bba74c0>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:01.048851 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1fedc723-3314-469b-9bd4-a43907be913a tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bc4ce50>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:01.087267 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-1fedc723-3314-469b-9bd4-a43907be913a tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] HTTP exception thrown: Snapshot eebbad5f-03fb-49f8-9077-5d88b7d5edae could not be found. Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1fedc723-3314-469b-9bd4-a43907be913a tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Request method failure captured: Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae HTTP/1.1 Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3q6Y1XCSkBboZuY_U_DiBHlIIrBot9omXi00aGt6fjsHRISs-84HwWv2MwwOTsV4_YuRvclzhWP1hM7ZXHOnDiemIHCJcL8KsunVNDDi5e9jayrEHY0M4byrw6kAfzDrDLhHlUTcGdcgniF9azCXm3V5Bf-sNbZUNAhN3ytnbVkMoo Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: d285f70190b04d64a240f7fcf648b7dd Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:47:01.091368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d285f70190b04d64a240f7fcf648b7dd"}]}] Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: d285f70190b04d64a240f7fcf648b7dd Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-VolumesSnapshotsTestJSON-1297074420-project Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: a188768395324f928027ea6f72e7f9de Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1297074420-project Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Snapshot eebbad5f-03fb-49f8-9077-5d88b7d5edae could not be found. Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': 'eebbad5f-03fb-49f8-9077-5d88b7d5edae'} Aug 22 12:47:01.092689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot eebbad5f-03fb-49f8-9077-5d88b7d5edae could not be found. (HTTP 404) (Request-ID: req-fabfcc8d-3b23-4e4f-b0d6-8b78a7d1d270) Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:01.093511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 12:47:01.095231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot eebbad5f-03fb-49f8-9077-5d88b7d5edae could not be found. Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 22 12:47:01.096335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot eebbad5f-03fb-49f8-9077-5d88b7d5edae could not be found. Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot eebbad5f-03fb-49f8-9077-5d88b7d5edae could not be found. Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:01.097481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1fedc723-3314-469b-9bd4-a43907be913a tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Returning 404 to user: Snapshot eebbad5f-03fb-49f8-9077-5d88b7d5edae could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:47:01.099518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1fedc723-3314-469b-9bd4-a43907be913a tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae" status: 404 len: 111 microversion: 2.1 time: 0.054686 Aug 22 12:47:01.100310 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-18083215-def0-49da-833e-379bbc4b6e32 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.311694 Aug 22 12:47:01.101306 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 11/24] 10.222.0.15 () {58 vars in 1149 bytes} [Mon Aug 22 12:47:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:01.116250 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 14/25] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 22 12:47:01 2022] GET /compute/v2.1/os-snapshots/eebbad5f-03fb-49f8-9077-5d88b7d5edae => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:47:01.120129 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7f953a12-755c-4c12-9363-b372b0c740fc tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765c6078b0>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:01.130486 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-84321bba-52cf-43c2-bf23-31a012724336 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] Calling method '.version_select at 0x7f765c607b80>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:01.420031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-84321bba-52cf-43c2-bf23-31a012724336 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.293557 Aug 22 12:47:01.420112 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7f953a12-755c-4c12-9363-b372b0c740fc tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c" status: 202 len: 0 microversion: 2.1 time: 0.304749 Aug 22 12:47:01.420112 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 12/26] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 22 12:47:01 2022] DELETE /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:47:01.420959 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 15/27] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Aug 22 12:47:01 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:01.424502 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c2163818-6e3d-4310-9e5a-ae62d5b86d0b tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bc32c10>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:01.426812 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7008663f-96f3-481a-9a5e-4e1709571c28 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] Calling method '.version_select at 0x7f765bbb6a60>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:01.523764 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c2163818-6e3d-4310-9e5a-ae62d5b86d0b tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c" status: 200 len: 344 microversion: 2.1 time: 0.104861 Aug 22 12:47:01.530985 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 13/28] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:47:01 2022] GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:01.649341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7008663f-96f3-481a-9a5e-4e1709571c28 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.225931 Aug 22 12:47:01.661759 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 16/29] 10.222.0.15 () {58 vars in 1167 bytes} [Mon Aug 22 12:47:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:01.666065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ce62eeb8-04fa-469b-a77b-f93b42f0433b tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] Calling method '.version_select at 0x7f765bc329d0>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:01.878220 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ce62eeb8-04fa-469b-a77b-f93b42f0433b tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.217369 Aug 22 12:47:01.887546 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 14/30] 10.222.0.15 () {58 vars in 1170 bytes} [Mon Aug 22 12:47:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:01.895200 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-994348af-e7c6-43ed-9d78-b905b041392f tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] Calling method '.version_select at 0x7f765bbb9ca0>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:02.101795 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-994348af-e7c6-43ed-9d78-b905b041392f tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.211768 Aug 22 12:47:02.102682 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 17/31] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Aug 22 12:47:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:02.116846 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-12032909-675d-469f-af28-abfa4626e8f8 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] Calling method '.version_select at 0x7f765bba7ca0>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:02.335284 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-12032909-675d-469f-af28-abfa4626e8f8 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.216077 Aug 22 12:47:02.335284 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 15/32] 10.222.0.15 () {58 vars in 1188 bytes} [Mon Aug 22 12:47:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:47:02.343305 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-58771058-0d93-462b-88d2-572029290ba4 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] Calling method '.version_select at 0x7f765bbb9940>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:02.538205 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d17e681b-dbd0-49b1-a5e6-50ade80a6fa3 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bba7f70>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:02.591993 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-58771058-0d93-462b-88d2-572029290ba4 tempest-VolumesTestJSON-516762677 tempest-VolumesTestJSON-516762677-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.252566 Aug 22 12:47:02.599781 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 18/33] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Aug 22 12:47:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:02.607204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-d17e681b-dbd0-49b1-a5e6-50ade80a6fa3 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] HTTP exception thrown: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d17e681b-dbd0-49b1-a5e6-50ade80a6fa3 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Request method failure captured: Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c HTTP/1.1 Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3q6Y1XCSkBboZuY_U_DiBHlIIrBot9omXi00aGt6fjsHRISs-84HwWv2MwwOTsV4_YuRvclzhWP1hM7ZXHOnDiemIHCJcL8KsunVNDDi5e9jayrEHY0M4byrw6kAfzDrDLhHlUTcGdcgniF9azCXm3V5Bf-sNbZUNAhN3ytnbVkMoo Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: d285f70190b04d64a240f7fcf648b7dd Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:47:02.616583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d285f70190b04d64a240f7fcf648b7dd"}]}] Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: d285f70190b04d64a240f7fcf648b7dd Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-VolumesSnapshotsTestJSON-1297074420-project Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: a188768395324f928027ea6f72e7f9de Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1297074420-project Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '8d427413-b62d-4a30-ad22-d975b11e2a3c'} Aug 22 12:47:02.617695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. (HTTP 404) (Request-ID: req-b2bb647a-5025-44dc-929f-c59bb22e8539) Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:02.618320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 12:47:02.619242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 12:47:02.620135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d17e681b-dbd0-49b1-a5e6-50ade80a6fa3 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Returning 404 to user: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d17e681b-dbd0-49b1-a5e6-50ade80a6fa3 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c" status: 404 len: 109 microversion: 2.1 time: 0.076461 Aug 22 12:47:02.621002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 16/34] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:47:02 2022] GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:47:02.628624 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-013c9e38-8753-4eb0-afaf-be289af05737 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765c607a60>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-013c9e38-8753-4eb0-afaf-be289af05737 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] HTTP exception thrown: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-013c9e38-8753-4eb0-afaf-be289af05737 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Request method failure captured: Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: DELETE /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c HTTP/1.1 Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3q6Y1XCSkBboZuY_U_DiBHlIIrBot9omXi00aGt6fjsHRISs-84HwWv2MwwOTsV4_YuRvclzhWP1hM7ZXHOnDiemIHCJcL8KsunVNDDi5e9jayrEHY0M4byrw6kAfzDrDLhHlUTcGdcgniF9azCXm3V5Bf-sNbZUNAhN3ytnbVkMoo Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: d285f70190b04d64a240f7fcf648b7dd Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:47:02.776279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d285f70190b04d64a240f7fcf648b7dd"}]}] Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: d285f70190b04d64a240f7fcf648b7dd Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-VolumesSnapshotsTestJSON-1297074420-project Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: a188768395324f928027ea6f72e7f9de Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1297074420-project Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '8d427413-b62d-4a30-ad22-d975b11e2a3c'} Aug 22 12:47:02.777978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. (HTTP 404) (Request-ID: req-5f4d65fa-4571-4b60-ab40-ebbf4e7bd54f) Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:02.778710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 12:47:02.779614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 12:47:02.780518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-013c9e38-8753-4eb0-afaf-be289af05737 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Returning 404 to user: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-013c9e38-8753-4eb0-afaf-be289af05737 tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c" status: 404 len: 109 microversion: 2.1 time: 0.152196 Aug 22 12:47:02.781964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 19/35] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 22 12:47:02 2022] DELETE /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c => generated 109 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:47:02.785518 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-309a9526-bbd9-4c65-9c1c-90135050601b tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Calling method '.version_select at 0x7f765bc32e50>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:02.927038 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-309a9526-bbd9-4c65-9c1c-90135050601b tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] HTTP exception thrown: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-309a9526-bbd9-4c65-9c1c-90135050601b tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Request method failure captured: Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c HTTP/1.1 Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3q6Y1XCSkBboZuY_U_DiBHlIIrBot9omXi00aGt6fjsHRISs-84HwWv2MwwOTsV4_YuRvclzhWP1hM7ZXHOnDiemIHCJcL8KsunVNDDi5e9jayrEHY0M4byrw6kAfzDrDLhHlUTcGdcgniF9azCXm3V5Bf-sNbZUNAhN3ytnbVkMoo Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: d285f70190b04d64a240f7fcf648b7dd Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:47:02.929068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d285f70190b04d64a240f7fcf648b7dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d285f70190b04d64a240f7fcf648b7dd"}]}] Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: d285f70190b04d64a240f7fcf648b7dd Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1297074420 Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-VolumesSnapshotsTestJSON-1297074420-project Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: a188768395324f928027ea6f72e7f9de Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1297074420-project Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '8d427413-b62d-4a30-ad22-d975b11e2a3c'} Aug 22 12:47:02.934138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. (HTTP 404) (Request-ID: req-158984f0-f142-43ce-88d5-45045299d1d6) Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:02.934942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 12:47:02.936072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 12:47:02.937304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-309a9526-bbd9-4c65-9c1c-90135050601b tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] Returning 404 to user: Volume 8d427413-b62d-4a30-ad22-d975b11e2a3c could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-309a9526-bbd9-4c65-9c1c-90135050601b tempest-VolumesSnapshotsTestJSON-1297074420 tempest-VolumesSnapshotsTestJSON-1297074420-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c" status: 404 len: 109 microversion: 2.1 time: 0.149508 Aug 22 12:47:02.939365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 17/36] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:47:02 2022] GET /compute/v2.1/os-volumes/8d427413-b62d-4a30-ad22-d975b11e2a3c => generated 109 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:47:04.730525 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2018162826", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:05.003807 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.network.neutron [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] validate_networks() for [('dfc2933b-45ff-4b52-8faf-55b30a6eda74', None, None, None, None, None)] {{(pid=127810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:47:05.204796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1573659178", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "networks": [{"uuid": "13ed78b5-c1d1-4b60-a7da-32ea2e5e3d08"}]}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:05.450758 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] validate_networks() for [('13ed78b5-c1d1-4b60-a7da-32ea2e5e3d08', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:47:07.930995 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:47:07.932122 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:47:07.935447 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:47:07.938412 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:47:07.941085 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:47:07.988896 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:07.990034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:07.992587 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:07.995613 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:07.995613 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:07.995613 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:08.063082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Flavor limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:47:08.063082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Image limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:47:08.063082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Flavor pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:47:08.063082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Image pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:47:08.063082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:47:08.074840 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Getting quotas for project 5574355e5db64af7bf6a0469c29f5569. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:47:08.087106 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Getting quotas for user 56a8835b7a764c65820758eaf7accbbe and project 5574355e5db64af7bf6a0469c29f5569. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:47:08.089083 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:08.090439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:08.091662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:08.092677 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:08.094772 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:08.096386 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:08.119611 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:47:08.125429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:47:08.209595 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Getting quotas for project 30bf0498eabd4d9988b2084c0b082fad. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:47:08.239573 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Getting quotas for user 9767d18cf0944f16b45fff4214128c1a and project 30bf0498eabd4d9988b2084c0b082fad. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:47:08.274469 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Going to run 1 instances... {{(pid=127810) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:47:08.281127 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:47:08.349243 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6ccfe5b5-8502-45c0-9119-90f56d663c67 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.816339 Aug 22 12:47:08.350355 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:47:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:47:08.368995 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-23a54cc7-41e4-410d-b284-3da661f1a35f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:08.368995 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-23a54cc7-41e4-410d-b284-3da661f1a35f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:08.568504 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-23a54cc7-41e4-410d-b284-3da661f1a35f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:08.576183 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-18e71e4d-8e48-4c21-acac-6fad93f7ebe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.515891 Aug 22 12:47:08.578860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 20/38] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:47:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 4519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:47:08.606367 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-23a54cc7-41e4-410d-b284-3da661f1a35f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1215 microversion: 2.1 time: 0.246851 Aug 22 12:47:08.608245 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 19/39] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:08 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:08.620915 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-12a9f2a2-f8a9-481d-b1d9-b54acfd913b8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:08.623164 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-12a9f2a2-f8a9-481d-b1d9-b54acfd913b8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:08.770519 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-12a9f2a2-f8a9-481d-b1d9-b54acfd913b8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:08.781284 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-12a9f2a2-f8a9-481d-b1d9-b54acfd913b8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1222 microversion: 2.1 time: 0.169201 Aug 22 12:47:08.783628 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 20/40] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:08 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1222 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:08.956312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-14405cb4-692a-46d1-81e5-5a858a368a7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Action: 'create', calling method: .version_select at 0x7f765b2c4280>, body: {"keypair": {"name": "tempest-keypair-1547492172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyBjfrJ43Q7J+jNM5hfIdz1RPf0pvDxaG0J+wgFp8Joua/hf3Dr1J4c9L7dDsDQ+JYhSqc3xtfrjwKwpxhn8kdhc6PBL1uUSgwhQlmwiA/DsxW17WDkguFYw0vxUTajrg=="}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:09.032208 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-14405cb4-692a-46d1-81e5-5a858a368a7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Getting quotas for project 97408eeab80e45f9a27c405c23038f8c. Resources: {'key_pairs'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:47:09.044706 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-14405cb4-692a-46d1-81e5-5a858a368a7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Getting quotas for user 36a40c9d61174c38b007ba0a30fc95c3 and project 97408eeab80e45f9a27c405c23038f8c. Resources: {'key_pairs'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:47:09.258904 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-14405cb4-692a-46d1-81e5-5a858a368a7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.677593 Aug 22 12:47:09.266937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 21/41] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Aug 22 12:47:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 679 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 12:47:09.465653 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2a66a1bd-2fa2-4613-96be-85af6e4cb307 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Action: 'create', calling method: .version_select at 0x7f765aa679d0>, body: {"keypair": {"name": "tempest-keypair-682175871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyGBCQUwDwdV2OOq+qs9DRRtVeuwGVYpvAYYTjCfRuqniZ2Qh+8oGtPpOwCMhw+SZd7npftnsNjzQw7xD0VXFQsMrh8thj/cBw/NgUbUran/JCLGvsrBwGva6CHID7bTw=="}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:09.548671 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-2a66a1bd-2fa2-4613-96be-85af6e4cb307 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Getting quotas for project d2e81d9adcb6477aa19c0cbacca01351. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:47:09.562928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-2a66a1bd-2fa2-4613-96be-85af6e4cb307 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Getting quotas for user 5b1db5be49014d2cba63cdee9df5b1d0 and project d2e81d9adcb6477aa19c0cbacca01351. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:47:09.629006 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-20ade88b-dee1-42e9-9b32-9c8324725115 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:09.629904 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-20ade88b-dee1-42e9-9b32-9c8324725115 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:09.766440 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2a66a1bd-2fa2-4613-96be-85af6e4cb307 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.981254 Aug 22 12:47:09.767753 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 21/42] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 22 12:47:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:09.773575 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-417921932", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:09.824958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-20ade88b-dee1-42e9-9b32-9c8324725115 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:09.877105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-20ade88b-dee1-42e9-9b32-9c8324725115 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1215 microversion: 2.1 time: 0.233855 Aug 22 12:47:09.879583 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 22/43] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:09 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:09.916633 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] validate_networks() for [('dfc2933b-45ff-4b52-8faf-55b30a6eda74', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:47:10.904995 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8125126b-4ece-4a99-8fee-99f2ac397fb2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:10.907843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8125126b-4ece-4a99-8fee-99f2ac397fb2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:10.956408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:47:10.957400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:47:10.960070 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:47:10.960763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:47:10.961404 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:47:10.993025 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:10.996039 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:10.996501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:11.005357 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:11.008185 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:11.008657 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:11.068384 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Getting quotas for project 30bf0498eabd4d9988b2084c0b082fad. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:47:11.081801 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Getting quotas for user 9767d18cf0944f16b45fff4214128c1a and project 30bf0498eabd4d9988b2084c0b082fad. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:47:11.118859 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:47:11.128203 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8125126b-4ece-4a99-8fee-99f2ac397fb2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:11.148803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:47:11.155142 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8125126b-4ece-4a99-8fee-99f2ac397fb2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1215 microversion: 2.1 time: 0.258291 Aug 22 12:47:11.166397 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 23/44] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:10 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:11.414538 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-74592f91-fa6d-496c-a536-6cdb4e92c3a7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.645578 Aug 22 12:47:11.415187 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:47:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:47:11.426445 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-324c8f0e-d21e-4fe8-9b57-6dc4cde74a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:11.427510 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-324c8f0e-d21e-4fe8-9b57-6dc4cde74a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:11.557922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-324c8f0e-d21e-4fe8-9b57-6dc4cde74a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:11.568035 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-324c8f0e-d21e-4fe8-9b57-6dc4cde74a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1221 microversion: 2.1 time: 0.145847 Aug 22 12:47:11.583312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 24/46] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:11 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1221 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:12.180747 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-57cef0bb-0935-44c4-98b7-c6fce572f0ff tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:12.182057 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-57cef0bb-0935-44c4-98b7-c6fce572f0ff tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:12.258029 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-57cef0bb-0935-44c4-98b7-c6fce572f0ff tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:12.277915 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-57cef0bb-0935-44c4-98b7-c6fce572f0ff tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1215 microversion: 2.1 time: 0.103115 Aug 22 12:47:12.278540 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 23/47] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:12 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:12.592898 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-80d4451f-ac04-4c2c-94b9-88428db30448 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:12.593631 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-80d4451f-ac04-4c2c-94b9-88428db30448 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:12.782331 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-80d4451f-ac04-4c2c-94b9-88428db30448 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:12.791196 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-80d4451f-ac04-4c2c-94b9-88428db30448 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1221 microversion: 2.1 time: 0.200966 Aug 22 12:47:12.791840 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:12 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1221 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:13.304721 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c10bdf54-da7a-4d19-b830-eaa0aaf20d41 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:13.306160 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c10bdf54-da7a-4d19-b830-eaa0aaf20d41 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:13.329454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10bdf54-da7a-4d19-b830-eaa0aaf20d41 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:13.330047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10bdf54-da7a-4d19-b830-eaa0aaf20d41 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:13.332391 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10bdf54-da7a-4d19-b830-eaa0aaf20d41 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:13.333212 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10bdf54-da7a-4d19-b830-eaa0aaf20d41 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:13.334449 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10bdf54-da7a-4d19-b830-eaa0aaf20d41 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:13.336443 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10bdf54-da7a-4d19-b830-eaa0aaf20d41 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:13.541892 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c10bdf54-da7a-4d19-b830-eaa0aaf20d41 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:13.562579 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c10bdf54-da7a-4d19-b830-eaa0aaf20d41 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1211 microversion: 2.1 time: 0.261897 Aug 22 12:47:13.578123 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 24/49] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:13 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1211 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:13.814173 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-313477ae-c153-475f-9072-3759e74c97c1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:13.814827 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-313477ae-c153-475f-9072-3759e74c97c1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:13.822641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-313477ae-c153-475f-9072-3759e74c97c1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:13.854263 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-313477ae-c153-475f-9072-3759e74c97c1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:13.864243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-313477ae-c153-475f-9072-3759e74c97c1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:13.864990 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-313477ae-c153-475f-9072-3759e74c97c1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:13.865661 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-313477ae-c153-475f-9072-3759e74c97c1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:13.867184 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-313477ae-c153-475f-9072-3759e74c97c1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:14.065091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-313477ae-c153-475f-9072-3759e74c97c1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:14.078736 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-313477ae-c153-475f-9072-3759e74c97c1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1217 microversion: 2.1 time: 0.268196 Aug 22 12:47:14.092014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 26/50] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:13 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:14.586175 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c53ff267-def8-4d79-98fd-afdce3266368 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:14.586827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c53ff267-def8-4d79-98fd-afdce3266368 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:14.596654 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c53ff267-def8-4d79-98fd-afdce3266368 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:14.597852 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c53ff267-def8-4d79-98fd-afdce3266368 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:14.598827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c53ff267-def8-4d79-98fd-afdce3266368 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:14.599892 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c53ff267-def8-4d79-98fd-afdce3266368 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:14.600530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c53ff267-def8-4d79-98fd-afdce3266368 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:14.601113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c53ff267-def8-4d79-98fd-afdce3266368 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:14.701682 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c53ff267-def8-4d79-98fd-afdce3266368 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:14.710508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c53ff267-def8-4d79-98fd-afdce3266368 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1267 microversion: 2.1 time: 0.128107 Aug 22 12:47:14.711230 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 25/51] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:14 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:15.109186 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-19f9aea4-a1b1-4dc6-bd26-3a73558bfd2f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:15.110007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1463041366", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "674b889e-bd8d-4c99-a4a1-55e76da1b696"}], "security_groups": [{"name": "tempest-securitygroup--1106549562"}], "key_name": "tempest-keypair-1547492172", "user_data": "}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:15.110156 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-19f9aea4-a1b1-4dc6-bd26-3a73558bfd2f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:15.122074 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19f9aea4-a1b1-4dc6-bd26-3a73558bfd2f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:15.122726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19f9aea4-a1b1-4dc6-bd26-3a73558bfd2f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:15.123390 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19f9aea4-a1b1-4dc6-bd26-3a73558bfd2f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:15.125026 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19f9aea4-a1b1-4dc6-bd26-3a73558bfd2f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:15.125652 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19f9aea4-a1b1-4dc6-bd26-3a73558bfd2f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:15.126297 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19f9aea4-a1b1-4dc6-bd26-3a73558bfd2f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:15.216319 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-19f9aea4-a1b1-4dc6-bd26-3a73558bfd2f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:15.226048 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-19f9aea4-a1b1-4dc6-bd26-3a73558bfd2f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1273 microversion: 2.1 time: 0.124147 Aug 22 12:47:15.226989 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 27/52] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:15 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:15.429410 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] validate_networks() for [('674b889e-bd8d-4c99-a4a1-55e76da1b696', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:47:15.433520 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1895590855", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49d8665d-f9be-4c27-9fb3-77166a6f137c"}], "security_groups": [{"name": "tempest-securitygroup--1054513400"}], "key_name": "tempest-keypair-682175871", "user_data": "}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:15.634385 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.network.neutron [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] validate_networks() for [('49d8665d-f9be-4c27-9fb3-77166a6f137c', None, None, None, None, None)] {{(pid=127810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:47:16.274568 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:47:16.275335 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:47:16.276461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:47:16.276777 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:47:16.280386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:47:16.291173 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:16.291867 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:16.292684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:16.293723 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:16.294448 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:16.295027 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:16.351656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Getting quotas for project 97408eeab80e45f9a27c405c23038f8c. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:47:16.351656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Getting quotas for user 36a40c9d61174c38b007ba0a30fc95c3 and project 97408eeab80e45f9a27c405c23038f8c. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:47:16.356587 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Flavor limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:47:16.357598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Image limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:47:16.358248 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Flavor pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:47:16.359506 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Image pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:47:16.360133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:47:16.368747 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:16.369070 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:47:16.369237 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:16.369714 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:16.370503 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:16.370948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:16.371301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:47:16.371428 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:16.390858 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Getting quotas for project d2e81d9adcb6477aa19c0cbacca01351. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:47:16.394873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Getting quotas for user 5b1db5be49014d2cba63cdee9df5b1d0 and project d2e81d9adcb6477aa19c0cbacca01351. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:47:16.407164 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Going to run 1 instances... {{(pid=127810) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:47:16.409415 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:47:16.639427 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9c099d65-7eab-46d4-8955-af3d2bed436e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.534753 Aug 22 12:47:16.642087 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 26/53] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Aug 22 12:47:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 22 12:47:16.651147 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-12ad910f-4701-4b97-8673-b6b263ac1bab tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:16.657681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-12ad910f-4701-4b97-8673-b6b263ac1bab tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:16.665689 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-12ad910f-4701-4b97-8673-b6b263ac1bab tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:16.669204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-12ad910f-4701-4b97-8673-b6b263ac1bab tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:16.669661 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-12ad910f-4701-4b97-8673-b6b263ac1bab tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:16.677005 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-12ad910f-4701-4b97-8673-b6b263ac1bab tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:16.677005 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-12ad910f-4701-4b97-8673-b6b263ac1bab tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:16.677157 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-12ad910f-4701-4b97-8673-b6b263ac1bab tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:16.698360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e3afd690-72e0-44d0-ae68-0c81ef465248 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.269483 Aug 22 12:47:16.700668 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 28/54] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:47:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:47:16.705819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4e897afb-e006-4086-8712-27d48edc24b4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:16.717180 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4e897afb-e006-4086-8712-27d48edc24b4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:16.728372 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e897afb-e006-4086-8712-27d48edc24b4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:16.734299 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e897afb-e006-4086-8712-27d48edc24b4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:16.735009 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e897afb-e006-4086-8712-27d48edc24b4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:16.736615 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e897afb-e006-4086-8712-27d48edc24b4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:16.737249 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e897afb-e006-4086-8712-27d48edc24b4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:16.737834 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e897afb-e006-4086-8712-27d48edc24b4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:16.811153 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-12ad910f-4701-4b97-8673-b6b263ac1bab tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:16.820286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-12ad910f-4701-4b97-8673-b6b263ac1bab tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1267 microversion: 2.1 time: 0.178427 Aug 22 12:47:16.827941 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 27/55] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:16 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:16.845747 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-04246540-1004-4cc9-8d25-376497ffe102 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:16.846619 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-04246540-1004-4cc9-8d25-376497ffe102 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:16.883485 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-4e897afb-e006-4086-8712-27d48edc24b4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:16.934025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4e897afb-e006-4086-8712-27d48edc24b4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1273 microversion: 2.1 time: 0.232315 Aug 22 12:47:16.940058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 29/56] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:16 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:16.969114 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8a2c3d4a-d88a-4afd-82db-8672bda359ce tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:16.972813 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8a2c3d4a-d88a-4afd-82db-8672bda359ce tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:17.023802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-04246540-1004-4cc9-8d25-376497ffe102 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:17.040403 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-04246540-1004-4cc9-8d25-376497ffe102 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:17.044916 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-04246540-1004-4cc9-8d25-376497ffe102 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:17.046960 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-04246540-1004-4cc9-8d25-376497ffe102 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1282 microversion: 2.20 time: 0.217505 Aug 22 12:47:17.048101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 28/57] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:16 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1282 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:17.149274 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8a2c3d4a-d88a-4afd-82db-8672bda359ce tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:17.156345 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8a2c3d4a-d88a-4afd-82db-8672bda359ce tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1237 microversion: 2.1 time: 0.215235 Aug 22 12:47:17.179336 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 30/58] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:16 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1237 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:17.844756 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ea72af56-3d23-46d6-b97f-40adfbfa121d tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:17.845381 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ea72af56-3d23-46d6-b97f-40adfbfa121d tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:17.855302 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea72af56-3d23-46d6-b97f-40adfbfa121d tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:17.858099 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea72af56-3d23-46d6-b97f-40adfbfa121d tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:17.861877 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea72af56-3d23-46d6-b97f-40adfbfa121d tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:17.862916 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea72af56-3d23-46d6-b97f-40adfbfa121d tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:17.863596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea72af56-3d23-46d6-b97f-40adfbfa121d tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:17.864262 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea72af56-3d23-46d6-b97f-40adfbfa121d tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:17.961966 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f2001fc8-d5fd-4215-8347-a2b1720261e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:17.963382 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f2001fc8-d5fd-4215-8347-a2b1720261e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:17.973019 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f2001fc8-d5fd-4215-8347-a2b1720261e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:17.973582 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f2001fc8-d5fd-4215-8347-a2b1720261e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:17.975674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f2001fc8-d5fd-4215-8347-a2b1720261e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:17.977554 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f2001fc8-d5fd-4215-8347-a2b1720261e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:17.978256 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f2001fc8-d5fd-4215-8347-a2b1720261e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:17.979436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f2001fc8-d5fd-4215-8347-a2b1720261e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:18.170306 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ea72af56-3d23-46d6-b97f-40adfbfa121d tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:18.182066 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ea72af56-3d23-46d6-b97f-40adfbfa121d tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1275 microversion: 2.1 time: 0.341796 Aug 22 12:47:18.189183 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 29/59] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:17 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1275 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:18.213845 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bb7ced94-2457-4151-995f-7c2cef52ff2c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:18.214759 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bb7ced94-2457-4151-995f-7c2cef52ff2c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:18.297506 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f2001fc8-d5fd-4215-8347-a2b1720261e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:18.310819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f2001fc8-d5fd-4215-8347-a2b1720261e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1281 microversion: 2.1 time: 0.351425 Aug 22 12:47:18.313408 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 31/60] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:17 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1281 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:18.328830 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8a4f26ee-fe8b-4599-b4a1-ba67344e3909 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:18.331142 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8a4f26ee-fe8b-4599-b4a1-ba67344e3909 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:18.398088 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bb7ced94-2457-4151-995f-7c2cef52ff2c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:18.406966 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bb7ced94-2457-4151-995f-7c2cef52ff2c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:18.416941 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bb7ced94-2457-4151-995f-7c2cef52ff2c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:18.418494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bb7ced94-2457-4151-995f-7c2cef52ff2c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1282 microversion: 2.20 time: 0.225233 Aug 22 12:47:18.430536 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 30/61] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:18 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1282 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:18.533356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8a4f26ee-fe8b-4599-b4a1-ba67344e3909 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:18.543128 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8a4f26ee-fe8b-4599-b4a1-ba67344e3909 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1237 microversion: 2.1 time: 0.228424 Aug 22 12:47:18.543712 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 32/62] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:18 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1237 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:19.209084 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f211ef49-8177-48fb-8201-f4f506db95da tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:19.210505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f211ef49-8177-48fb-8201-f4f506db95da tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:19.221613 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f211ef49-8177-48fb-8201-f4f506db95da tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:19.222830 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f211ef49-8177-48fb-8201-f4f506db95da tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:19.223153 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f211ef49-8177-48fb-8201-f4f506db95da tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:19.224003 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f211ef49-8177-48fb-8201-f4f506db95da tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:19.224480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f211ef49-8177-48fb-8201-f4f506db95da tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:19.225343 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f211ef49-8177-48fb-8201-f4f506db95da tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:19.334293 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ba4c8761-ff28-420f-bd82-25e1e0067540 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:19.334997 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ba4c8761-ff28-420f-bd82-25e1e0067540 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:19.347926 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ba4c8761-ff28-420f-bd82-25e1e0067540 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:19.349944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ba4c8761-ff28-420f-bd82-25e1e0067540 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:19.350649 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ba4c8761-ff28-420f-bd82-25e1e0067540 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:19.353964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ba4c8761-ff28-420f-bd82-25e1e0067540 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:19.355540 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ba4c8761-ff28-420f-bd82-25e1e0067540 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:19.355993 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ba4c8761-ff28-420f-bd82-25e1e0067540 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:19.507367 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f211ef49-8177-48fb-8201-f4f506db95da tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:19.519852 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f211ef49-8177-48fb-8201-f4f506db95da tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1273 microversion: 2.1 time: 0.315429 Aug 22 12:47:19.523663 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 31/63] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:19 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1273 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:19.537696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:19.540471 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:19.552955 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:19.553462 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:19.553900 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:19.556938 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:19.557432 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:19.562600 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:19.575204 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ba4c8761-ff28-420f-bd82-25e1e0067540 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:19.595007 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ba4c8761-ff28-420f-bd82-25e1e0067540 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1279 microversion: 2.1 time: 0.265072 Aug 22 12:47:19.596164 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 33/64] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:19 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:19.621298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-90bbdeeb-d039-4f2d-9d0f-0ac21eb09294 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:19.625921 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-90bbdeeb-d039-4f2d-9d0f-0ac21eb09294 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:19.642345 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90bbdeeb-d039-4f2d-9d0f-0ac21eb09294 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:19.642845 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90bbdeeb-d039-4f2d-9d0f-0ac21eb09294 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:19.648523 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90bbdeeb-d039-4f2d-9d0f-0ac21eb09294 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:19.649737 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90bbdeeb-d039-4f2d-9d0f-0ac21eb09294 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:19.650476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90bbdeeb-d039-4f2d-9d0f-0ac21eb09294 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:19.654345 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90bbdeeb-d039-4f2d-9d0f-0ac21eb09294 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:19.781234 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:19.796880 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:19.801859 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:19.803470 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-16f83fcc-64a4-4a88-87d6-f199b5d8bbee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1278 microversion: 2.20 time: 0.277916 Aug 22 12:47:19.806725 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:19 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:19.898750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-90bbdeeb-d039-4f2d-9d0f-0ac21eb09294 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:19.918749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-90bbdeeb-d039-4f2d-9d0f-0ac21eb09294 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1233 microversion: 2.1 time: 0.314724 Aug 22 12:47:19.921672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 34/66] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:19 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1233 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:20.549751 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-54bc38cc-205e-41b0-8886-3817829d6a1a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:20.551088 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-54bc38cc-205e-41b0-8886-3817829d6a1a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:20.563071 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-54bc38cc-205e-41b0-8886-3817829d6a1a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:20.564826 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-54bc38cc-205e-41b0-8886-3817829d6a1a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:20.572363 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-54bc38cc-205e-41b0-8886-3817829d6a1a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:20.573619 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-54bc38cc-205e-41b0-8886-3817829d6a1a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:20.574130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-54bc38cc-205e-41b0-8886-3817829d6a1a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:20.575071 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-54bc38cc-205e-41b0-8886-3817829d6a1a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:20.623616 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1fb0512c-b3ba-49d9-834d-7deb5c576425 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:20.625567 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1fb0512c-b3ba-49d9-834d-7deb5c576425 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:20.635681 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1fb0512c-b3ba-49d9-834d-7deb5c576425 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:20.636622 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1fb0512c-b3ba-49d9-834d-7deb5c576425 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:20.637353 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1fb0512c-b3ba-49d9-834d-7deb5c576425 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:20.643426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1fb0512c-b3ba-49d9-834d-7deb5c576425 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:20.647040 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1fb0512c-b3ba-49d9-834d-7deb5c576425 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:20.648999 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1fb0512c-b3ba-49d9-834d-7deb5c576425 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:21.227042 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-54bc38cc-205e-41b0-8886-3817829d6a1a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:21.227042 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-54bc38cc-205e-41b0-8886-3817829d6a1a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.452926 Aug 22 12:47:21.227042 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 33/67] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:20 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:21.227042 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:21.229039 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:21.229039 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:21.229039 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:21.229039 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:21.230566 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:21.230566 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:21.230566 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:21.232819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1fb0512c-b3ba-49d9-834d-7deb5c576425 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:21.232819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1fb0512c-b3ba-49d9-834d-7deb5c576425 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.433600 Aug 22 12:47:21.232819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 35/68] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:20 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:21.232819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-5a58afb8-b9fe-442c-8864-178768589c2e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:21.234927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-5a58afb8-b9fe-442c-8864-178768589c2e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:21.234927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5a58afb8-b9fe-442c-8864-178768589c2e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:21.234927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5a58afb8-b9fe-442c-8864-178768589c2e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:21.234927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5a58afb8-b9fe-442c-8864-178768589c2e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:21.236172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5a58afb8-b9fe-442c-8864-178768589c2e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:21.236172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5a58afb8-b9fe-442c-8864-178768589c2e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:21.236172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5a58afb8-b9fe-442c-8864-178768589c2e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:21.236967 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:21.236967 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:21.237508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:21.237508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-4a10ac3e-770f-4ce6-ab85-289e0548d3d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1334 microversion: 2.20 time: 0.161830 Aug 22 12:47:21.237508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 34/69] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:20 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1334 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:21.238369 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-5a58afb8-b9fe-442c-8864-178768589c2e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:21.239462 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-5a58afb8-b9fe-442c-8864-178768589c2e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1289 microversion: 2.1 time: 0.187441 Aug 22 12:47:21.241493 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 36/70] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:21 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1289 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:22.180826 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0de2a3e3-6bb6-4e28-8764-317dead977ab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:22.181441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0de2a3e3-6bb6-4e28-8764-317dead977ab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:22.182377 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-01aaa122-ae87-418c-b448-8c17cfdac9eb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:22.182937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-01aaa122-ae87-418c-b448-8c17cfdac9eb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:22.194720 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:22.196181 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0de2a3e3-6bb6-4e28-8764-317dead977ab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:22.196676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0de2a3e3-6bb6-4e28-8764-317dead977ab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:22.201237 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-01aaa122-ae87-418c-b448-8c17cfdac9eb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:22.202329 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0de2a3e3-6bb6-4e28-8764-317dead977ab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:22.203388 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0de2a3e3-6bb6-4e28-8764-317dead977ab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:22.203903 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0de2a3e3-6bb6-4e28-8764-317dead977ab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:22.204212 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-01aaa122-ae87-418c-b448-8c17cfdac9eb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:22.204329 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0de2a3e3-6bb6-4e28-8764-317dead977ab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:22.204790 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-01aaa122-ae87-418c-b448-8c17cfdac9eb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:22.205397 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-01aaa122-ae87-418c-b448-8c17cfdac9eb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:22.205864 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-01aaa122-ae87-418c-b448-8c17cfdac9eb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:22.213464 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-01aaa122-ae87-418c-b448-8c17cfdac9eb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:22.591603 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0de2a3e3-6bb6-4e28-8764-317dead977ab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:22.596790 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-01aaa122-ae87-418c-b448-8c17cfdac9eb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:22.602057 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0de2a3e3-6bb6-4e28-8764-317dead977ab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.426118 Aug 22 12:47:22.603285 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 35/71] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:22 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:22.610400 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-01aaa122-ae87-418c-b448-8c17cfdac9eb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.430972 Aug 22 12:47:22.611022 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 37/72] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:22 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:22.613318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:22.614294 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:22.623641 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:22.625436 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:22.626428 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:22.627500 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:22.628546 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:22.628652 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a19c8b72-5722-4c20-838a-5691d10ec532 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:22.629227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a19c8b72-5722-4c20-838a-5691d10ec532 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:22.644357 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:22.673775 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a19c8b72-5722-4c20-838a-5691d10ec532 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:22.677093 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a19c8b72-5722-4c20-838a-5691d10ec532 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:22.688253 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a19c8b72-5722-4c20-838a-5691d10ec532 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:22.688253 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a19c8b72-5722-4c20-838a-5691d10ec532 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:22.688253 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a19c8b72-5722-4c20-838a-5691d10ec532 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:22.697408 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a19c8b72-5722-4c20-838a-5691d10ec532 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:22.832656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:22.849168 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:22.865065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:22.868734 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f4b0f2ad-5304-49b9-951a-fbed417beda2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1352 microversion: 2.20 time: 0.261799 Aug 22 12:47:22.872209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 36/73] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:22 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1352 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:22.901640 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a19c8b72-5722-4c20-838a-5691d10ec532 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:22.910314 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a19c8b72-5722-4c20-838a-5691d10ec532 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1297 microversion: 2.1 time: 0.298248 Aug 22 12:47:22.911479 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 38/74] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:22 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1297 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:23.010482 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-a5f85710-a5da-4a5f-a78f-7a14bcd048c0 req-0fbe8995-9641-4876-98f5-682925c42a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c28a24f-c2f3-412a-9d9b-b152e4407042", "tag": "0be03a40-3f02-4195-8045-9ce908e5f55e"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:23.025019 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-a5f85710-a5da-4a5f-a78f-7a14bcd048c0 req-0fbe8995-9641-4876-98f5-682925c42a30 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.033894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-a5f85710-a5da-4a5f-a78f-7a14bcd048c0 req-0fbe8995-9641-4876-98f5-682925c42a30 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.033894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-a5f85710-a5da-4a5f-a78f-7a14bcd048c0 req-0fbe8995-9641-4876-98f5-682925c42a30 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.050449 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-a5f85710-a5da-4a5f-a78f-7a14bcd048c0 req-0fbe8995-9641-4876-98f5-682925c42a30 service nova] Creating event network-changed:0be03a40-3f02-4195-8045-9ce908e5f55e for instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 on hv-cinder-85083 Aug 22 12:47:23.050980 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-a5f85710-a5da-4a5f-a78f-7a14bcd048c0 req-0fbe8995-9641-4876-98f5-682925c42a30 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 12:47:23.051397 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-a5f85710-a5da-4a5f-a78f-7a14bcd048c0 req-0fbe8995-9641-4876-98f5-682925c42a30 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 12:47:23.052390 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6866a200-9533-4f9f-a652-acf58d08c6f1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.052850 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6866a200-9533-4f9f-a652-acf58d08c6f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.053370 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6866a200-9533-4f9f-a652-acf58d08c6f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.054089 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6866a200-9533-4f9f-a652-acf58d08c6f1 None None] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.054573 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6866a200-9533-4f9f-a652-acf58d08c6f1 None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.054999 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6866a200-9533-4f9f-a652-acf58d08c6f1 None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.065117 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.compute.rpcapi [None req-6866a200-9533-4f9f-a652-acf58d08c6f1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 12:47:23.066006 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6866a200-9533-4f9f-a652-acf58d08c6f1 None None] Releasing lock "compute-rpcapi-router" {{(pid=127809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 12:47:23.082118 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6866a200-9533-4f9f-a652-acf58d08c6f1 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132250 Aug 22 12:47:23.082856 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 37/75] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:23.203361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-92d941c7-da92-4554-a461-b00803f012fc req-8ed537ac-c4df-4b06-9247-d3a5e984b76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d3d67d-bb7d-4e73-961f-a359e2954db9", "tag": "fcd8ebaa-5021-4d67-8795-1b1b3e62f91d"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:23.215888 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-92d941c7-da92-4554-a461-b00803f012fc req-8ed537ac-c4df-4b06-9247-d3a5e984b76d service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.216798 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-92d941c7-da92-4554-a461-b00803f012fc req-8ed537ac-c4df-4b06-9247-d3a5e984b76d service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.217459 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-92d941c7-da92-4554-a461-b00803f012fc req-8ed537ac-c4df-4b06-9247-d3a5e984b76d service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.237272 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-92d941c7-da92-4554-a461-b00803f012fc req-8ed537ac-c4df-4b06-9247-d3a5e984b76d service nova] Creating event network-changed:fcd8ebaa-5021-4d67-8795-1b1b3e62f91d for instance 08d3d67d-bb7d-4e73-961f-a359e2954db9 on hv-cinder-85083 Aug 22 12:47:23.237801 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-92d941c7-da92-4554-a461-b00803f012fc req-8ed537ac-c4df-4b06-9247-d3a5e984b76d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 12:47:23.238288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-92d941c7-da92-4554-a461-b00803f012fc req-8ed537ac-c4df-4b06-9247-d3a5e984b76d service nova] Acquired lock "compute-rpcapi-router" {{(pid=127810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 12:47:23.239252 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274b294e-cc7e-4471-9184-781d2332ffef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.239713 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274b294e-cc7e-4471-9184-781d2332ffef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.240145 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274b294e-cc7e-4471-9184-781d2332ffef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.240855 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274b294e-cc7e-4471-9184-781d2332ffef None None] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.241308 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274b294e-cc7e-4471-9184-781d2332ffef None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.241728 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274b294e-cc7e-4471-9184-781d2332ffef None None] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.250995 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.compute.rpcapi [None req-274b294e-cc7e-4471-9184-781d2332ffef None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 12:47:23.251869 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274b294e-cc7e-4471-9184-781d2332ffef None None] Releasing lock "compute-rpcapi-router" {{(pid=127810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 12:47:23.267594 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-274b294e-cc7e-4471-9184-781d2332ffef None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134664 Aug 22 12:47:23.268243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 39/76] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:23.629349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a7a4d238-4ee0-4839-821c-6d341a471a03 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:23.629349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a7a4d238-4ee0-4839-821c-6d341a471a03 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:23.632820 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7a4d238-4ee0-4839-821c-6d341a471a03 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.633305 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7a4d238-4ee0-4839-821c-6d341a471a03 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.633744 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7a4d238-4ee0-4839-821c-6d341a471a03 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.634458 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7a4d238-4ee0-4839-821c-6d341a471a03 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.634912 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7a4d238-4ee0-4839-821c-6d341a471a03 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.635339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7a4d238-4ee0-4839-821c-6d341a471a03 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.643146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e903c71f-7232-4cf7-9e0b-a678224057fc tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:23.643854 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e903c71f-7232-4cf7-9e0b-a678224057fc tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:23.649948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e903c71f-7232-4cf7-9e0b-a678224057fc tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.650473 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e903c71f-7232-4cf7-9e0b-a678224057fc tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.650920 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e903c71f-7232-4cf7-9e0b-a678224057fc tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.652938 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e903c71f-7232-4cf7-9e0b-a678224057fc tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.653415 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e903c71f-7232-4cf7-9e0b-a678224057fc tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.653853 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e903c71f-7232-4cf7-9e0b-a678224057fc tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.834224 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a7a4d238-4ee0-4839-821c-6d341a471a03 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:23.839867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e903c71f-7232-4cf7-9e0b-a678224057fc tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:23.843489 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a7a4d238-4ee0-4839-821c-6d341a471a03 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.222485 Aug 22 12:47:23.844078 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 38/77] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:23 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:23.848022 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e903c71f-7232-4cf7-9e0b-a678224057fc tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.209708 Aug 22 12:47:23.848588 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 40/78] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:23 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:23.897021 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:23.897676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:23.903530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.904015 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.904445 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.905147 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.905599 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.906019 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.932081 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-436f5c7f-bfbd-40be-b343-e38143904893 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:23.932726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-436f5c7f-bfbd-40be-b343-e38143904893 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:23.939228 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-436f5c7f-bfbd-40be-b343-e38143904893 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.939717 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-436f5c7f-bfbd-40be-b343-e38143904893 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.940163 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-436f5c7f-bfbd-40be-b343-e38143904893 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.940860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-436f5c7f-bfbd-40be-b343-e38143904893 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:23.941375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-436f5c7f-bfbd-40be-b343-e38143904893 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:23.941768 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-436f5c7f-bfbd-40be-b343-e38143904893 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:23.969839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:23.981315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:23.982961 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:23.984724 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bdbbe942-7b8b-40df-a413-8e7f37325d26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1352 microversion: 2.20 time: 0.091404 Aug 22 12:47:23.985279 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 39/79] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:23 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:24.119305 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-436f5c7f-bfbd-40be-b343-e38143904893 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:24.127876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-436f5c7f-bfbd-40be-b343-e38143904893 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1297 microversion: 2.1 time: 0.199411 Aug 22 12:47:24.128435 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 41/80] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:23 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1297 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:24.864696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-656b3369-8874-4713-84c8-5a88dd21541c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:24.865338 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-656b3369-8874-4713-84c8-5a88dd21541c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:24.868560 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-9c08337d-6d5a-4b8f-8c30-682367ffe649 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:24.877078 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-9c08337d-6d5a-4b8f-8c30-682367ffe649 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:24.877233 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-656b3369-8874-4713-84c8-5a88dd21541c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:24.877233 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-656b3369-8874-4713-84c8-5a88dd21541c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:24.877233 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-656b3369-8874-4713-84c8-5a88dd21541c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:24.877233 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-656b3369-8874-4713-84c8-5a88dd21541c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:24.877557 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-656b3369-8874-4713-84c8-5a88dd21541c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:24.877557 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-656b3369-8874-4713-84c8-5a88dd21541c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:24.877716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c08337d-6d5a-4b8f-8c30-682367ffe649 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:24.877716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c08337d-6d5a-4b8f-8c30-682367ffe649 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:24.877716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c08337d-6d5a-4b8f-8c30-682367ffe649 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:24.877716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c08337d-6d5a-4b8f-8c30-682367ffe649 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:24.878146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c08337d-6d5a-4b8f-8c30-682367ffe649 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:24.878614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c08337d-6d5a-4b8f-8c30-682367ffe649 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:25.073999 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9c08337d-6d5a-4b8f-8c30-682367ffe649 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:25.076459 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-656b3369-8874-4713-84c8-5a88dd21541c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:25.082821 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-9c08337d-6d5a-4b8f-8c30-682367ffe649 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.217956 Aug 22 12:47:25.094775 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 42/81] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:24 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:25.112083 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:25.112083 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:25.112245 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-656b3369-8874-4713-84c8-5a88dd21541c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.244972 Aug 22 12:47:25.112245 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 40/82] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:24 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:25.112377 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:25.112377 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:25.112377 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:25.112377 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:25.112634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:25.112634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:25.112634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:25.150865 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c67c66e1-7a45-417b-91b7-2d3b81a6b228 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:25.152026 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c67c66e1-7a45-417b-91b7-2d3b81a6b228 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:25.159738 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c67c66e1-7a45-417b-91b7-2d3b81a6b228 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:25.160390 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c67c66e1-7a45-417b-91b7-2d3b81a6b228 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:25.160894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c67c66e1-7a45-417b-91b7-2d3b81a6b228 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:25.161679 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c67c66e1-7a45-417b-91b7-2d3b81a6b228 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:25.162260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c67c66e1-7a45-417b-91b7-2d3b81a6b228 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:25.162756 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c67c66e1-7a45-417b-91b7-2d3b81a6b228 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:25.203742 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:25.207013 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:25.208792 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:25.210074 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2341d254-1871-4d90-913a-56279ddd9f97 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1352 microversion: 2.20 time: 0.114012 Aug 22 12:47:25.210893 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 43/83] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:25 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:25.240905 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c67c66e1-7a45-417b-91b7-2d3b81a6b228 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:25.249671 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c67c66e1-7a45-417b-91b7-2d3b81a6b228 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1297 microversion: 2.1 time: 0.103331 Aug 22 12:47:25.258326 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 41/84] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:25 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:25.283025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-b96e7a7e-f7b8-4154-92e1-89570c18a9af req-c0218061-2ce8-4f21-8de4-73dc21bfbf22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb90990-6e18-45a2-88c4-b725b54a21d6", "tag": "b51d6432-4f41-4a2a-87f5-dc19cddc2adc"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:25.301679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b96e7a7e-f7b8-4154-92e1-89570c18a9af req-c0218061-2ce8-4f21-8de4-73dc21bfbf22 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:25.309409 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b96e7a7e-f7b8-4154-92e1-89570c18a9af req-c0218061-2ce8-4f21-8de4-73dc21bfbf22 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:25.309409 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b96e7a7e-f7b8-4154-92e1-89570c18a9af req-c0218061-2ce8-4f21-8de4-73dc21bfbf22 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:25.314476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-b96e7a7e-f7b8-4154-92e1-89570c18a9af req-c0218061-2ce8-4f21-8de4-73dc21bfbf22 service nova] Creating event network-changed:b51d6432-4f41-4a2a-87f5-dc19cddc2adc for instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 on hv-cinder-85083 Aug 22 12:47:25.319474 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-b96e7a7e-f7b8-4154-92e1-89570c18a9af req-c0218061-2ce8-4f21-8de4-73dc21bfbf22 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040972 Aug 22 12:47:25.320158 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 44/85] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:26.106940 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-41003879-6708-47c4-bd8e-a9596b0b4220 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:26.107592 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-41003879-6708-47c4-bd8e-a9596b0b4220 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:26.114295 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41003879-6708-47c4-bd8e-a9596b0b4220 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:26.114798 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41003879-6708-47c4-bd8e-a9596b0b4220 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:26.115232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41003879-6708-47c4-bd8e-a9596b0b4220 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:26.115953 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41003879-6708-47c4-bd8e-a9596b0b4220 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:26.116413 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41003879-6708-47c4-bd8e-a9596b0b4220 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:26.116844 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41003879-6708-47c4-bd8e-a9596b0b4220 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:26.132205 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d929ed5c-810c-4f3b-85ee-086cff696c4e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:26.133707 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d929ed5c-810c-4f3b-85ee-086cff696c4e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:26.144578 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d929ed5c-810c-4f3b-85ee-086cff696c4e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:26.145392 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d929ed5c-810c-4f3b-85ee-086cff696c4e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:26.145936 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d929ed5c-810c-4f3b-85ee-086cff696c4e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:26.146784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d929ed5c-810c-4f3b-85ee-086cff696c4e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:26.147370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d929ed5c-810c-4f3b-85ee-086cff696c4e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:26.147777 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d929ed5c-810c-4f3b-85ee-086cff696c4e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:26.345660 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d929ed5c-810c-4f3b-85ee-086cff696c4e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:26.349906 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=100 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:26.357228 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d929ed5c-810c-4f3b-85ee-086cff696c4e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.229563 Aug 22 12:47:26.371680 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-41003879-6708-47c4-bd8e-a9596b0b4220 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:26.371942 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 45/86] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:26 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:26.376014 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=100 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:26.377680 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:26.378431 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:26.380997 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-41003879-6708-47c4-bd8e-a9596b0b4220 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.278073 Aug 22 12:47:26.381572 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 42/87] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:26 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:26.386654 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-29a6fa63-4fa1-4bda-b006-f163f89da369 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:26.387295 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-29a6fa63-4fa1-4bda-b006-f163f89da369 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:26.393153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:26.393720 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:26.394258 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:26.394357 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-29a6fa63-4fa1-4bda-b006-f163f89da369 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:26.394757 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-29a6fa63-4fa1-4bda-b006-f163f89da369 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:26.395050 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:26.395158 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-29a6fa63-4fa1-4bda-b006-f163f89da369 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:26.395514 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:26.395843 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-29a6fa63-4fa1-4bda-b006-f163f89da369 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:26.395948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:26.396295 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-29a6fa63-4fa1-4bda-b006-f163f89da369 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:26.396716 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-29a6fa63-4fa1-4bda-b006-f163f89da369 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:26.481507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:26.494140 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:26.495912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:26.497188 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-17411ac2-3b21-411e-92fc-73999e96cc79 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1340 microversion: 2.20 time: 0.124041 Aug 22 12:47:26.498170 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 46/88] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:26 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1340 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:26.515448 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-29a6fa63-4fa1-4bda-b006-f163f89da369 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:26.527267 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-29a6fa63-4fa1-4bda-b006-f163f89da369 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1297 microversion: 2.1 time: 0.144442 Aug 22 12:47:26.527845 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 43/89] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:26 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1297 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:27.379774 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0ed0962d-adfe-4eef-b24e-2564180e0573 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:27.380995 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0ed0962d-adfe-4eef-b24e-2564180e0573 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:27.388001 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0ed0962d-adfe-4eef-b24e-2564180e0573 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:27.388740 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0ed0962d-adfe-4eef-b24e-2564180e0573 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:27.389329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0ed0962d-adfe-4eef-b24e-2564180e0573 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:27.390463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0ed0962d-adfe-4eef-b24e-2564180e0573 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:27.390999 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0ed0962d-adfe-4eef-b24e-2564180e0573 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:27.391527 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0ed0962d-adfe-4eef-b24e-2564180e0573 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:27.403933 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dae9981a-f1c4-47fd-895b-1e24665d5765 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:27.412954 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-dae9981a-f1c4-47fd-895b-1e24665d5765 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:27.421177 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dae9981a-f1c4-47fd-895b-1e24665d5765 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:27.421883 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dae9981a-f1c4-47fd-895b-1e24665d5765 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:27.422345 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dae9981a-f1c4-47fd-895b-1e24665d5765 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:27.423435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dae9981a-f1c4-47fd-895b-1e24665d5765 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:27.423932 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dae9981a-f1c4-47fd-895b-1e24665d5765 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:27.424479 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dae9981a-f1c4-47fd-895b-1e24665d5765 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:27.596388 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0ed0962d-adfe-4eef-b24e-2564180e0573 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:27.604492 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0ed0962d-adfe-4eef-b24e-2564180e0573 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.229797 Aug 22 12:47:27.605078 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 47/90] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:27 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:27.622908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:27.623521 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:27.629796 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:27.630055 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:27.630693 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:27.631568 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:27.632182 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:27.632795 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:27.651492 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-dae9981a-f1c4-47fd-895b-1e24665d5765 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:27.660519 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-dae9981a-f1c4-47fd-895b-1e24665d5765 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.260857 Aug 22 12:47:27.660519 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 44/91] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:27 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:27.665132 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-52bab2a7-df32-496d-a77e-d0305d441b00 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:27.665932 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-52bab2a7-df32-496d-a77e-d0305d441b00 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:27.672103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52bab2a7-df32-496d-a77e-d0305d441b00 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:27.678257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52bab2a7-df32-496d-a77e-d0305d441b00 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:27.678999 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52bab2a7-df32-496d-a77e-d0305d441b00 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:27.679919 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52bab2a7-df32-496d-a77e-d0305d441b00 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:27.680673 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52bab2a7-df32-496d-a77e-d0305d441b00 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:27.681244 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52bab2a7-df32-496d-a77e-d0305d441b00 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:27.713842 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:27.723778 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:27.724174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:27.725282 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-31d7fcde-ca6e-4faa-bef2-0a210e862db6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1340 microversion: 2.20 time: 0.106260 Aug 22 12:47:27.730231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 48/92] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:27 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1340 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:27.773298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-52bab2a7-df32-496d-a77e-d0305d441b00 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:27.780399 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-52bab2a7-df32-496d-a77e-d0305d441b00 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1297 microversion: 2.1 time: 0.118461 Aug 22 12:47:27.781059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 45/93] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:27 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1297 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:28.626084 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-546a8246-6882-462e-9843-1af0bf9e2716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:28.626724 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-546a8246-6882-462e-9843-1af0bf9e2716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:28.628665 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=28 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:28.633912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-546a8246-6882-462e-9843-1af0bf9e2716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:28.634807 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-546a8246-6882-462e-9843-1af0bf9e2716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:28.635553 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-546a8246-6882-462e-9843-1af0bf9e2716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:28.636498 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-546a8246-6882-462e-9843-1af0bf9e2716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:28.637034 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-546a8246-6882-462e-9843-1af0bf9e2716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:28.637846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-546a8246-6882-462e-9843-1af0bf9e2716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:28.686895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-35a64853-f9f6-493e-b7a5-775a21b98227 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:28.688397 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-35a64853-f9f6-493e-b7a5-775a21b98227 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:28.690454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=32 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:28.695918 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35a64853-f9f6-493e-b7a5-775a21b98227 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:28.696624 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35a64853-f9f6-493e-b7a5-775a21b98227 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:28.697415 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35a64853-f9f6-493e-b7a5-775a21b98227 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:28.698681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35a64853-f9f6-493e-b7a5-775a21b98227 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:28.703409 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35a64853-f9f6-493e-b7a5-775a21b98227 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:28.703409 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35a64853-f9f6-493e-b7a5-775a21b98227 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:28.847479 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-546a8246-6882-462e-9843-1af0bf9e2716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:28.856203 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-546a8246-6882-462e-9843-1af0bf9e2716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.234679 Aug 22 12:47:28.859306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 49/94] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:28 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:28.872741 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:28.873275 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:28.881140 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:28.881863 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:28.882570 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:28.883451 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:28.884049 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:28.884623 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:28.901352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-35a64853-f9f6-493e-b7a5-775a21b98227 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:28.907649 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-35a64853-f9f6-493e-b7a5-775a21b98227 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.229674 Aug 22 12:47:28.909048 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 46/95] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:28 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:28.919102 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-fac2bb33-da34-439c-8edf-a4c3f1fc12be tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:28.920061 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-fac2bb33-da34-439c-8edf-a4c3f1fc12be tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:28.930554 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fac2bb33-da34-439c-8edf-a4c3f1fc12be tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:28.931302 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fac2bb33-da34-439c-8edf-a4c3f1fc12be tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:28.931738 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fac2bb33-da34-439c-8edf-a4c3f1fc12be tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:28.932440 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fac2bb33-da34-439c-8edf-a4c3f1fc12be tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:28.932890 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fac2bb33-da34-439c-8edf-a4c3f1fc12be tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:28.933308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fac2bb33-da34-439c-8edf-a4c3f1fc12be tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:28.959801 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:28.969956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:28.972319 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:28.973712 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-92d4d5ac-5731-486d-8e6a-897370bbd96c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1340 microversion: 2.20 time: 0.113291 Aug 22 12:47:28.978859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 50/96] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:28 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1340 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:29.039610 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-fac2bb33-da34-439c-8edf-a4c3f1fc12be tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:29.055092 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-fac2bb33-da34-439c-8edf-a4c3f1fc12be tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1297 microversion: 2.1 time: 0.137679 Aug 22 12:47:29.056266 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 47/97] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:28 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1297 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:29.885732 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2fe1320a-ff59-4fd7-821e-ef22045d2882 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:29.886804 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2fe1320a-ff59-4fd7-821e-ef22045d2882 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:29.893929 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fe1320a-ff59-4fd7-821e-ef22045d2882 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:29.894540 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fe1320a-ff59-4fd7-821e-ef22045d2882 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:29.895046 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fe1320a-ff59-4fd7-821e-ef22045d2882 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:29.895905 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fe1320a-ff59-4fd7-821e-ef22045d2882 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:29.896462 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fe1320a-ff59-4fd7-821e-ef22045d2882 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:29.897589 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fe1320a-ff59-4fd7-821e-ef22045d2882 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:29.941424 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b26cef12-7a7a-42ed-964e-e5af8348cf7c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:29.941424 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b26cef12-7a7a-42ed-964e-e5af8348cf7c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:29.948587 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b26cef12-7a7a-42ed-964e-e5af8348cf7c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:29.950673 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b26cef12-7a7a-42ed-964e-e5af8348cf7c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:29.952737 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b26cef12-7a7a-42ed-964e-e5af8348cf7c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:29.954716 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b26cef12-7a7a-42ed-964e-e5af8348cf7c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:29.955224 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b26cef12-7a7a-42ed-964e-e5af8348cf7c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:29.960741 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b26cef12-7a7a-42ed-964e-e5af8348cf7c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:30.194966 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2fe1320a-ff59-4fd7-821e-ef22045d2882 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:30.202609 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b26cef12-7a7a-42ed-964e-e5af8348cf7c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:30.204696 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2fe1320a-ff59-4fd7-821e-ef22045d2882 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.323165 Aug 22 12:47:30.205557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 51/98] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:29 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:30.213957 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:30.214125 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b26cef12-7a7a-42ed-964e-e5af8348cf7c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.286129 Aug 22 12:47:30.214773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:30.219972 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 48/99] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:29 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:30.224277 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:30.224899 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:30.225320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7c65f549-7832-42bc-9db1-84695ad1666e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:30.225526 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:30.226267 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7c65f549-7832-42bc-9db1-84695ad1666e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:30.226810 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:30.227843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:30.228437 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:30.233808 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c65f549-7832-42bc-9db1-84695ad1666e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:30.234584 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c65f549-7832-42bc-9db1-84695ad1666e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:30.235182 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c65f549-7832-42bc-9db1-84695ad1666e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:30.236028 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c65f549-7832-42bc-9db1-84695ad1666e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:30.236667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c65f549-7832-42bc-9db1-84695ad1666e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:30.237232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c65f549-7832-42bc-9db1-84695ad1666e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:30.319561 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:30.330367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:30.332020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:30.333551 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-62982aba-af80-46ab-9b26-5a9b44eb00f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1340 microversion: 2.20 time: 0.126590 Aug 22 12:47:30.334695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 52/100] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:30 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1340 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:30.365422 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7c65f549-7832-42bc-9db1-84695ad1666e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:30.386919 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7c65f549-7832-42bc-9db1-84695ad1666e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1297 microversion: 2.1 time: 0.162455 Aug 22 12:47:30.386919 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 49/101] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:30 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1297 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:31.226818 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-72b4e360-e4a2-4b45-bc7a-fe7ab7615716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:31.227363 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-72b4e360-e4a2-4b45-bc7a-fe7ab7615716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:31.234262 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72b4e360-e4a2-4b45-bc7a-fe7ab7615716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:31.234756 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72b4e360-e4a2-4b45-bc7a-fe7ab7615716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:31.235199 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72b4e360-e4a2-4b45-bc7a-fe7ab7615716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:31.235895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72b4e360-e4a2-4b45-bc7a-fe7ab7615716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:31.236354 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72b4e360-e4a2-4b45-bc7a-fe7ab7615716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:31.236743 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5f859be5-e828-4c56-8961-11c3332b4a8b tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:31.237145 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72b4e360-e4a2-4b45-bc7a-fe7ab7615716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:31.237479 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-5f859be5-e828-4c56-8961-11c3332b4a8b tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:31.243317 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5f859be5-e828-4c56-8961-11c3332b4a8b tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:31.243797 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5f859be5-e828-4c56-8961-11c3332b4a8b tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:31.244233 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5f859be5-e828-4c56-8961-11c3332b4a8b tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:31.245296 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5f859be5-e828-4c56-8961-11c3332b4a8b tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:31.246010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5f859be5-e828-4c56-8961-11c3332b4a8b tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:31.246466 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5f859be5-e828-4c56-8961-11c3332b4a8b tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:31.432845 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-72b4e360-e4a2-4b45-bc7a-fe7ab7615716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:31.436859 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-5f859be5-e828-4c56-8961-11c3332b4a8b tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:31.440623 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-72b4e360-e4a2-4b45-bc7a-fe7ab7615716 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.217700 Aug 22 12:47:31.441198 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 53/102] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:31 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:31.444769 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-5f859be5-e828-4c56-8961-11c3332b4a8b tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.212554 Aug 22 12:47:31.445328 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 50/103] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:31 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:31.445680 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:31.446984 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:31.450270 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6078afd6-48d5-44a0-a70a-ff6dbe00f89a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:31.451307 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6078afd6-48d5-44a0-a70a-ff6dbe00f89a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:31.454821 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:31.455414 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:31.455966 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:31.456806 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:31.457411 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:31.457628 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6078afd6-48d5-44a0-a70a-ff6dbe00f89a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:31.458080 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:31.458207 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6078afd6-48d5-44a0-a70a-ff6dbe00f89a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:31.458581 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6078afd6-48d5-44a0-a70a-ff6dbe00f89a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:31.459275 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6078afd6-48d5-44a0-a70a-ff6dbe00f89a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:31.459739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6078afd6-48d5-44a0-a70a-ff6dbe00f89a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:31.460163 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6078afd6-48d5-44a0-a70a-ff6dbe00f89a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:31.542612 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:31.544243 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6078afd6-48d5-44a0-a70a-ff6dbe00f89a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:31.551863 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:31.553513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:31.554199 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6078afd6-48d5-44a0-a70a-ff6dbe00f89a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1297 microversion: 2.1 time: 0.107359 Aug 22 12:47:31.554784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 51/104] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:31 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:31.554877 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-38d85b88-dbeb-419b-bbe0-666405d875a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1340 microversion: 2.20 time: 0.112713 Aug 22 12:47:31.555609 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 54/105] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:31 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1340 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:32.461510 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a138647e-9612-446b-9a23-f0eb75ce8c2a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:32.462323 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a138647e-9612-446b-9a23-f0eb75ce8c2a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:32.470305 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a138647e-9612-446b-9a23-f0eb75ce8c2a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:32.474707 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-45f92c24-425e-4cc9-a073-d82509d3de97 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:32.475187 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a138647e-9612-446b-9a23-f0eb75ce8c2a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:32.475187 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a138647e-9612-446b-9a23-f0eb75ce8c2a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:32.475361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-45f92c24-425e-4cc9-a073-d82509d3de97 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:32.475484 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a138647e-9612-446b-9a23-f0eb75ce8c2a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:32.475484 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a138647e-9612-446b-9a23-f0eb75ce8c2a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:32.475484 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a138647e-9612-446b-9a23-f0eb75ce8c2a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:32.483611 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-45f92c24-425e-4cc9-a073-d82509d3de97 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:32.484368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-45f92c24-425e-4cc9-a073-d82509d3de97 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:32.485088 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-45f92c24-425e-4cc9-a073-d82509d3de97 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:32.486363 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-45f92c24-425e-4cc9-a073-d82509d3de97 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:32.487589 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-45f92c24-425e-4cc9-a073-d82509d3de97 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:32.488022 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-45f92c24-425e-4cc9-a073-d82509d3de97 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:33.071269 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=8 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:33.097728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a138647e-9612-446b-9a23-f0eb75ce8c2a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:33.099735 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-45f92c24-425e-4cc9-a073-d82509d3de97 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:33.111436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-45f92c24-425e-4cc9-a073-d82509d3de97 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.647455 Aug 22 12:47:33.112581 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 55/106] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:32 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:33.113261 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a138647e-9612-446b-9a23-f0eb75ce8c2a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.656173 Aug 22 12:47:33.127429 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-5b4f23b9-2aa7-4acd-b1ce-648914d07251 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:33.127429 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-5b4f23b9-2aa7-4acd-b1ce-648914d07251 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:33.130957 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b4f23b9-2aa7-4acd-b1ce-648914d07251 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:33.131084 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 52/107] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:32 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:33.131180 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b4f23b9-2aa7-4acd-b1ce-648914d07251 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:33.131180 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b4f23b9-2aa7-4acd-b1ce-648914d07251 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:33.131416 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b4f23b9-2aa7-4acd-b1ce-648914d07251 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:33.131875 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b4f23b9-2aa7-4acd-b1ce-648914d07251 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:33.132289 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b4f23b9-2aa7-4acd-b1ce-648914d07251 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:33.149115 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:33.149948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:33.162210 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:33.164856 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:33.164856 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:33.164856 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:33.165136 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:33.165691 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:33.249605 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=6 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:33.270277 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-5b4f23b9-2aa7-4acd-b1ce-648914d07251 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:33.281094 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-5b4f23b9-2aa7-4acd-b1ce-648914d07251 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1295 microversion: 2.1 time: 0.167237 Aug 22 12:47:33.282520 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 56/108] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:33 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1295 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:33.385931 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:33.395231 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:33.396872 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:33.398045 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-793ec483-5906-48ba-9dd5-293b08a11518 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1340 microversion: 2.20 time: 0.260221 Aug 22 12:47:33.398913 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 53/109] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:33 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1340 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:34.132614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-84e002e1-5805-4ff0-832c-e29cb05338d6 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:34.133339 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-84e002e1-5805-4ff0-832c-e29cb05338d6 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:34.133899 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a7f89ca9-190d-4bae-a019-1f32aecaef06 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:34.134672 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a7f89ca9-190d-4bae-a019-1f32aecaef06 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:34.140787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-84e002e1-5805-4ff0-832c-e29cb05338d6 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:34.140990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7f89ca9-190d-4bae-a019-1f32aecaef06 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:34.141276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-84e002e1-5805-4ff0-832c-e29cb05338d6 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:34.141467 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7f89ca9-190d-4bae-a019-1f32aecaef06 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:34.141716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-84e002e1-5805-4ff0-832c-e29cb05338d6 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:34.141895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7f89ca9-190d-4bae-a019-1f32aecaef06 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:34.142437 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-84e002e1-5805-4ff0-832c-e29cb05338d6 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:34.142709 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7f89ca9-190d-4bae-a019-1f32aecaef06 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:34.142944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-84e002e1-5805-4ff0-832c-e29cb05338d6 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:34.143050 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7f89ca9-190d-4bae-a019-1f32aecaef06 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:34.143369 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-84e002e1-5805-4ff0-832c-e29cb05338d6 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:34.143462 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7f89ca9-190d-4bae-a019-1f32aecaef06 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:34.343649 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a7f89ca9-190d-4bae-a019-1f32aecaef06 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:34.356576 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-84e002e1-5805-4ff0-832c-e29cb05338d6 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:34.361575 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a7f89ca9-190d-4bae-a019-1f32aecaef06 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.230570 Aug 22 12:47:34.366073 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 54/110] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:34 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:34.370628 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-84bcc874-5f98-46f9-ac9d-97cf04528272 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:34.371714 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-84e002e1-5805-4ff0-832c-e29cb05338d6 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.243162 Aug 22 12:47:34.372232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 57/111] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:34 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:34.372590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-84bcc874-5f98-46f9-ac9d-97cf04528272 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:34.379561 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84bcc874-5f98-46f9-ac9d-97cf04528272 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:34.380192 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84bcc874-5f98-46f9-ac9d-97cf04528272 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:34.380760 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84bcc874-5f98-46f9-ac9d-97cf04528272 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:34.381586 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84bcc874-5f98-46f9-ac9d-97cf04528272 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:34.383495 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84bcc874-5f98-46f9-ac9d-97cf04528272 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:34.384009 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84bcc874-5f98-46f9-ac9d-97cf04528272 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:34.421132 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:34.421816 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:34.428507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:34.429048 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:34.429452 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:34.430129 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:34.430607 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:34.431030 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:34.587097 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-84bcc874-5f98-46f9-ac9d-97cf04528272 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:34.594885 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-84bcc874-5f98-46f9-ac9d-97cf04528272 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.227698 Aug 22 12:47:34.596703 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 55/112] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:34 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:34.611426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:34.619809 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:34.622156 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:34.623208 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7a809fa4-c886-40c9-b4a0-f56ba99ad550 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.205995 Aug 22 12:47:34.637877 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 58/113] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:34 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:47:35.387260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e2ee8ebe-630d-4d39-8551-1b175b945eb5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:35.387889 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e2ee8ebe-630d-4d39-8551-1b175b945eb5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:35.396668 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2ee8ebe-630d-4d39-8551-1b175b945eb5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:35.397142 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2ee8ebe-630d-4d39-8551-1b175b945eb5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:35.397765 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2ee8ebe-630d-4d39-8551-1b175b945eb5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:35.398565 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2ee8ebe-630d-4d39-8551-1b175b945eb5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:35.399482 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2ee8ebe-630d-4d39-8551-1b175b945eb5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:35.399791 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-aac78879-8301-4225-93bf-ef82fcc5fce0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:35.400582 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2ee8ebe-630d-4d39-8551-1b175b945eb5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:35.400696 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-aac78879-8301-4225-93bf-ef82fcc5fce0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:35.418681 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aac78879-8301-4225-93bf-ef82fcc5fce0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:35.419473 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aac78879-8301-4225-93bf-ef82fcc5fce0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:35.420157 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aac78879-8301-4225-93bf-ef82fcc5fce0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:35.423153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aac78879-8301-4225-93bf-ef82fcc5fce0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:35.424695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aac78879-8301-4225-93bf-ef82fcc5fce0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:35.425245 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aac78879-8301-4225-93bf-ef82fcc5fce0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:35.609382 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e2ee8ebe-630d-4d39-8551-1b175b945eb5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:35.627937 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e2ee8ebe-630d-4d39-8551-1b175b945eb5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.246898 Aug 22 12:47:35.628979 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 56/114] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:35 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:35.635160 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-245ae78e-82e9-4a54-a519-06e88bdd4ed3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:35.635778 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-245ae78e-82e9-4a54-a519-06e88bdd4ed3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:35.641826 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-245ae78e-82e9-4a54-a519-06e88bdd4ed3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:35.642604 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-245ae78e-82e9-4a54-a519-06e88bdd4ed3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:35.643258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-245ae78e-82e9-4a54-a519-06e88bdd4ed3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:35.644036 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-245ae78e-82e9-4a54-a519-06e88bdd4ed3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:35.644604 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-245ae78e-82e9-4a54-a519-06e88bdd4ed3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:35.645104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-245ae78e-82e9-4a54-a519-06e88bdd4ed3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:35.645348 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-aac78879-8301-4225-93bf-ef82fcc5fce0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:35.655291 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-aac78879-8301-4225-93bf-ef82fcc5fce0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.261042 Aug 22 12:47:35.655877 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 59/115] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:35 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:35.660619 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:35.661394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:35.667497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:35.677393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:35.677393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:35.677393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:35.677393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:35.677735 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:35.858148 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-245ae78e-82e9-4a54-a519-06e88bdd4ed3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:35.867326 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-245ae78e-82e9-4a54-a519-06e88bdd4ed3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.235976 Aug 22 12:47:35.880831 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 57/116] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:35 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:35.887301 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:35.897728 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:35.900844 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:35.901079 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a66572f6-0cc4-471f-86a5-d08495ec3cab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.244009 Aug 22 12:47:35.910833 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 60/117] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:35 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:36.142510 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-5d49a09d-9973-4bc9-952e-9cab516daab2 req-71648209-17d6-486a-97a9-74c0fea117a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e060778-7e35-44e9-99f4-f2fb64f07928", "tag": "b8fb88da-a096-4c45-bd62-6606ee956319"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:36.153366 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-5d49a09d-9973-4bc9-952e-9cab516daab2 req-71648209-17d6-486a-97a9-74c0fea117a5 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:36.153819 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-5d49a09d-9973-4bc9-952e-9cab516daab2 req-71648209-17d6-486a-97a9-74c0fea117a5 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:36.155209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-5d49a09d-9973-4bc9-952e-9cab516daab2 req-71648209-17d6-486a-97a9-74c0fea117a5 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:36.167040 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-5d49a09d-9973-4bc9-952e-9cab516daab2 req-71648209-17d6-486a-97a9-74c0fea117a5 service nova] Creating event network-changed:b8fb88da-a096-4c45-bd62-6606ee956319 for instance 4e060778-7e35-44e9-99f4-f2fb64f07928 on hv-cinder-85083 Aug 22 12:47:36.172310 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-5d49a09d-9973-4bc9-952e-9cab516daab2 req-71648209-17d6-486a-97a9-74c0fea117a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034345 Aug 22 12:47:36.176638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 58/118] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:36.649855 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6876627e-99b0-490b-8e67-431dd7930574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:36.650519 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6876627e-99b0-490b-8e67-431dd7930574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:36.656568 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6876627e-99b0-490b-8e67-431dd7930574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:36.657238 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6876627e-99b0-490b-8e67-431dd7930574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:36.659003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6876627e-99b0-490b-8e67-431dd7930574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:36.659003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6876627e-99b0-490b-8e67-431dd7930574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:36.659003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6876627e-99b0-490b-8e67-431dd7930574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:36.659385 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6876627e-99b0-490b-8e67-431dd7930574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:36.676902 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2d580fbf-372d-4b1d-a4fb-4528cde38fe2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:36.677594 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2d580fbf-372d-4b1d-a4fb-4528cde38fe2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:36.683831 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d580fbf-372d-4b1d-a4fb-4528cde38fe2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:36.684324 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d580fbf-372d-4b1d-a4fb-4528cde38fe2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:36.684766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d580fbf-372d-4b1d-a4fb-4528cde38fe2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:36.685491 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d580fbf-372d-4b1d-a4fb-4528cde38fe2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:36.686639 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d580fbf-372d-4b1d-a4fb-4528cde38fe2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:36.687068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d580fbf-372d-4b1d-a4fb-4528cde38fe2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:36.986548 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6876627e-99b0-490b-8e67-431dd7930574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:36.995496 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6876627e-99b0-490b-8e67-431dd7930574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.349390 Aug 22 12:47:36.996063 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 61/119] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:36 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:37.000707 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3d2f56e8-3ab8-4787-a81d-db754052cf33 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:37.001311 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3d2f56e8-3ab8-4787-a81d-db754052cf33 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:37.007101 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2f56e8-3ab8-4787-a81d-db754052cf33 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:37.007587 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2f56e8-3ab8-4787-a81d-db754052cf33 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:37.008020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2f56e8-3ab8-4787-a81d-db754052cf33 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:37.008389 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2d580fbf-372d-4b1d-a4fb-4528cde38fe2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:37.008888 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2f56e8-3ab8-4787-a81d-db754052cf33 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:37.009345 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2f56e8-3ab8-4787-a81d-db754052cf33 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:37.009895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2f56e8-3ab8-4787-a81d-db754052cf33 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:37.016618 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2d580fbf-372d-4b1d-a4fb-4528cde38fe2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.343956 Aug 22 12:47:37.017271 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 59/120] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:36 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:37.021954 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:37.022715 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:37.028399 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=100 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:37.028538 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:37.029209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:37.030196 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:37.030893 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:37.031345 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:37.031769 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:37.035823 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=100 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:37.212903 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3d2f56e8-3ab8-4787-a81d-db754052cf33 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:37.222018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3d2f56e8-3ab8-4787-a81d-db754052cf33 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.224820 Aug 22 12:47:37.222965 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 62/121] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:36 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:37.224286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:37.232699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:37.234245 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:37.235340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a7df70e5-3cf1-4cc0-b308-9c7ce5e3938e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.217110 Aug 22 12:47:37.235894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 60/122] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:37 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:38.022140 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f15acdd6-45da-4758-a121-1eaecfc64f90 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:38.023195 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f15acdd6-45da-4758-a121-1eaecfc64f90 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:38.038650 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f15acdd6-45da-4758-a121-1eaecfc64f90 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:38.039286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f15acdd6-45da-4758-a121-1eaecfc64f90 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:38.039791 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f15acdd6-45da-4758-a121-1eaecfc64f90 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:38.039916 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-62c01927-1e77-4b1f-aa0d-3824f0ec3612 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:38.040442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-62c01927-1e77-4b1f-aa0d-3824f0ec3612 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:38.041211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f15acdd6-45da-4758-a121-1eaecfc64f90 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:38.041211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f15acdd6-45da-4758-a121-1eaecfc64f90 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:38.041716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f15acdd6-45da-4758-a121-1eaecfc64f90 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:38.048181 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62c01927-1e77-4b1f-aa0d-3824f0ec3612 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:38.048869 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62c01927-1e77-4b1f-aa0d-3824f0ec3612 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:38.049342 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62c01927-1e77-4b1f-aa0d-3824f0ec3612 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:38.050482 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62c01927-1e77-4b1f-aa0d-3824f0ec3612 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:38.051095 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62c01927-1e77-4b1f-aa0d-3824f0ec3612 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:38.051869 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62c01927-1e77-4b1f-aa0d-3824f0ec3612 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:38.250670 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-62c01927-1e77-4b1f-aa0d-3824f0ec3612 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:38.262847 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-62c01927-1e77-4b1f-aa0d-3824f0ec3612 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.227498 Aug 22 12:47:38.263399 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f15acdd6-45da-4758-a121-1eaecfc64f90 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:38.264611 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 61/123] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:38 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:38.274622 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-0c86c423-cd64-4291-9ef4-b2dc615ebe15 req-68880a75-83bd-4b25-8d1f-56dbc78021a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48cd5dbe-4358-40f8-9515-87434787eca4", "tag": "5e8ad75e-fce7-4867-9eae-2924ebf24649"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:38.276445 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f15acdd6-45da-4758-a121-1eaecfc64f90 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.259253 Aug 22 12:47:38.277458 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 63/124] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:38 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:38.283379 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f936367f-61aa-4293-88fd-da316a0f3a1a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:38.284200 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f936367f-61aa-4293-88fd-da316a0f3a1a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:38.286216 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-0c86c423-cd64-4291-9ef4-b2dc615ebe15 req-68880a75-83bd-4b25-8d1f-56dbc78021a9 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:38.286753 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-0c86c423-cd64-4291-9ef4-b2dc615ebe15 req-68880a75-83bd-4b25-8d1f-56dbc78021a9 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:38.293452 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-0c86c423-cd64-4291-9ef4-b2dc615ebe15 req-68880a75-83bd-4b25-8d1f-56dbc78021a9 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:38.295444 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f936367f-61aa-4293-88fd-da316a0f3a1a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:38.295940 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f936367f-61aa-4293-88fd-da316a0f3a1a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:38.296478 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f936367f-61aa-4293-88fd-da316a0f3a1a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:38.299819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f936367f-61aa-4293-88fd-da316a0f3a1a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:38.299819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f936367f-61aa-4293-88fd-da316a0f3a1a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:38.299819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f936367f-61aa-4293-88fd-da316a0f3a1a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:38.307388 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-0c86c423-cd64-4291-9ef4-b2dc615ebe15 req-68880a75-83bd-4b25-8d1f-56dbc78021a9 service nova] Creating event network-changed:5e8ad75e-fce7-4867-9eae-2924ebf24649 for instance 48cd5dbe-4358-40f8-9515-87434787eca4 on hv-cinder-85083 Aug 22 12:47:38.312320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-0c86c423-cd64-4291-9ef4-b2dc615ebe15 req-68880a75-83bd-4b25-8d1f-56dbc78021a9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046296 Aug 22 12:47:38.313186 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 62/125] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:38.318298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:38.319017 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:38.325422 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:38.325910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:38.326867 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:38.327562 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:38.328013 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:38.328431 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:38.511940 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:38.514893 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f936367f-61aa-4293-88fd-da316a0f3a1a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:38.522361 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:38.523285 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:38.525209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-02a14870-d8d7-4afe-b047-01654b6d313a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.210947 Aug 22 12:47:38.525771 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 63/126] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:38 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:38.529217 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f936367f-61aa-4293-88fd-da316a0f3a1a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.249992 Aug 22 12:47:38.542588 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 64/127] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:38 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:39.284227 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-def7c3e0-0877-4d1a-958d-548420dbe89c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:39.284947 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-def7c3e0-0877-4d1a-958d-548420dbe89c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:39.293510 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-def7c3e0-0877-4d1a-958d-548420dbe89c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:39.295895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-def7c3e0-0877-4d1a-958d-548420dbe89c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:39.296566 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-def7c3e0-0877-4d1a-958d-548420dbe89c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:39.297357 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-def7c3e0-0877-4d1a-958d-548420dbe89c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:39.297889 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-def7c3e0-0877-4d1a-958d-548420dbe89c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:39.298421 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-def7c3e0-0877-4d1a-958d-548420dbe89c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:39.301058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-508418c9-c698-4cb1-972d-41fa82b6805d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:39.301777 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-508418c9-c698-4cb1-972d-41fa82b6805d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:39.310404 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-508418c9-c698-4cb1-972d-41fa82b6805d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:39.310903 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-508418c9-c698-4cb1-972d-41fa82b6805d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:39.311343 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-508418c9-c698-4cb1-972d-41fa82b6805d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:39.312048 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-508418c9-c698-4cb1-972d-41fa82b6805d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:39.312505 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-508418c9-c698-4cb1-972d-41fa82b6805d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:39.312946 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-508418c9-c698-4cb1-972d-41fa82b6805d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:39.495428 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-def7c3e0-0877-4d1a-958d-548420dbe89c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:39.504665 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-def7c3e0-0877-4d1a-958d-548420dbe89c tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.225083 Aug 22 12:47:39.505237 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 64/128] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:39 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:39.529034 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-508418c9-c698-4cb1-972d-41fa82b6805d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:39.537362 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-508418c9-c698-4cb1-972d-41fa82b6805d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.240045 Aug 22 12:47:39.537926 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 65/129] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:39 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:39.548329 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:39.548932 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:39.552191 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ff363467-ccc5-4968-9390-ba438ce9b238 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:39.552801 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ff363467-ccc5-4968-9390-ba438ce9b238 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:39.554873 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:39.555352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:39.555778 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:39.556470 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:39.556916 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:39.557329 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:39.559060 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff363467-ccc5-4968-9390-ba438ce9b238 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:39.559578 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff363467-ccc5-4968-9390-ba438ce9b238 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:39.560195 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff363467-ccc5-4968-9390-ba438ce9b238 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:39.560947 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff363467-ccc5-4968-9390-ba438ce9b238 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:39.561438 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff363467-ccc5-4968-9390-ba438ce9b238 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:39.561861 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff363467-ccc5-4968-9390-ba438ce9b238 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:39.768574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:39.772146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ff363467-ccc5-4968-9390-ba438ce9b238 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:39.795201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:39.795201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:39.795201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-346f0eeb-bcb6-47a6-9603-47b4de8cf95d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.241991 Aug 22 12:47:39.795528 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 65/130] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:39 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:39.795597 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ff363467-ccc5-4968-9390-ba438ce9b238 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.243069 Aug 22 12:47:39.795597 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 66/131] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:39 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:40.225542 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-ed849815-bb98-4ccb-8189-24fd3939e461 req-81097200-1e85-4af4-ba37-e4e905188233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb90990-6e18-45a2-88c4-b725b54a21d6", "name": "network-vif-plugged", "status": "completed", "tag": "b51d6432-4f41-4a2a-87f5-dc19cddc2adc"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:40.235435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-ed849815-bb98-4ccb-8189-24fd3939e461 req-81097200-1e85-4af4-ba37-e4e905188233 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:40.235918 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-ed849815-bb98-4ccb-8189-24fd3939e461 req-81097200-1e85-4af4-ba37-e4e905188233 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:40.236356 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-ed849815-bb98-4ccb-8189-24fd3939e461 req-81097200-1e85-4af4-ba37-e4e905188233 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:40.247422 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-ed849815-bb98-4ccb-8189-24fd3939e461 req-81097200-1e85-4af4-ba37-e4e905188233 service nova] Creating event network-vif-plugged:b51d6432-4f41-4a2a-87f5-dc19cddc2adc for instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 on hv-cinder-85083 Aug 22 12:47:40.252785 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-ed849815-bb98-4ccb-8189-24fd3939e461 req-81097200-1e85-4af4-ba37-e4e905188233 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087992 Aug 22 12:47:40.253381 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 66/132] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:40.525009 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-64623ee5-e419-4296-926d-90cde961ca8f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:40.525558 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-64623ee5-e419-4296-926d-90cde961ca8f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:40.531552 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64623ee5-e419-4296-926d-90cde961ca8f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:40.532033 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64623ee5-e419-4296-926d-90cde961ca8f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:40.532463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64623ee5-e419-4296-926d-90cde961ca8f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:40.533153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64623ee5-e419-4296-926d-90cde961ca8f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:40.533603 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64623ee5-e419-4296-926d-90cde961ca8f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:40.534023 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64623ee5-e419-4296-926d-90cde961ca8f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:40.559702 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dad772c8-938a-45e9-9d7c-a028752bf2ba tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:40.562366 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-dad772c8-938a-45e9-9d7c-a028752bf2ba tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:40.575891 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dad772c8-938a-45e9-9d7c-a028752bf2ba tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:40.577081 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dad772c8-938a-45e9-9d7c-a028752bf2ba tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:40.578275 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dad772c8-938a-45e9-9d7c-a028752bf2ba tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:40.581255 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dad772c8-938a-45e9-9d7c-a028752bf2ba tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:40.581998 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dad772c8-938a-45e9-9d7c-a028752bf2ba tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:40.582669 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dad772c8-938a-45e9-9d7c-a028752bf2ba tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:40.990824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-64623ee5-e419-4296-926d-90cde961ca8f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:41.009358 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-64623ee5-e419-4296-926d-90cde961ca8f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.486875 Aug 22 12:47:41.015202 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 67/133] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:40 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:41.032739 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:41.033322 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:41.041407 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:41.042154 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:41.042852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:41.044027 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:41.044742 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:41.045943 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:41.048819 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-dad772c8-938a-45e9-9d7c-a028752bf2ba tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:41.059571 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-dad772c8-938a-45e9-9d7c-a028752bf2ba tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.504573 Aug 22 12:47:41.061923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 67/134] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:40 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:41.067814 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0f69e360-1d93-4321-a345-b1f8b8ea2f0b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:41.070380 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0f69e360-1d93-4321-a345-b1f8b8ea2f0b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:41.078063 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0f69e360-1d93-4321-a345-b1f8b8ea2f0b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:41.088157 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0f69e360-1d93-4321-a345-b1f8b8ea2f0b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:41.088717 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0f69e360-1d93-4321-a345-b1f8b8ea2f0b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:41.089546 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0f69e360-1d93-4321-a345-b1f8b8ea2f0b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:41.090090 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0f69e360-1d93-4321-a345-b1f8b8ea2f0b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:41.115464 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0f69e360-1d93-4321-a345-b1f8b8ea2f0b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:41.361079 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:41.369386 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:41.371025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:41.372194 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-69d09af2-c5b8-4a89-92a4-e9aeaf3c6fdb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.355794 Aug 22 12:47:41.372894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 68/135] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:41 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:41.399025 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0f69e360-1d93-4321-a345-b1f8b8ea2f0b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:41.406889 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0f69e360-1d93-4321-a345-b1f8b8ea2f0b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.343656 Aug 22 12:47:41.407458 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 68/136] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:41 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:42.035373 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d0a36fc1-50e7-48c3-9e6f-d2b315eb8f82 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:42.036634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d0a36fc1-50e7-48c3-9e6f-d2b315eb8f82 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:42.042893 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d0a36fc1-50e7-48c3-9e6f-d2b315eb8f82 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:42.043382 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d0a36fc1-50e7-48c3-9e6f-d2b315eb8f82 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:42.044025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d0a36fc1-50e7-48c3-9e6f-d2b315eb8f82 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:42.044719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d0a36fc1-50e7-48c3-9e6f-d2b315eb8f82 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:42.045953 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d0a36fc1-50e7-48c3-9e6f-d2b315eb8f82 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:42.046405 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d0a36fc1-50e7-48c3-9e6f-d2b315eb8f82 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:42.081958 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e2167ce4-0019-483f-824a-b04bae0f928a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:42.082766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e2167ce4-0019-483f-824a-b04bae0f928a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:42.106443 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2167ce4-0019-483f-824a-b04bae0f928a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:42.107224 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2167ce4-0019-483f-824a-b04bae0f928a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:42.108541 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2167ce4-0019-483f-824a-b04bae0f928a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:42.109497 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2167ce4-0019-483f-824a-b04bae0f928a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:42.111132 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2167ce4-0019-483f-824a-b04bae0f928a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:42.112164 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e2167ce4-0019-483f-824a-b04bae0f928a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:42.277292 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d0a36fc1-50e7-48c3-9e6f-d2b315eb8f82 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:42.283943 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d0a36fc1-50e7-48c3-9e6f-d2b315eb8f82 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.252611 Aug 22 12:47:42.285201 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 69/137] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:42 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:42.320360 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e2167ce4-0019-483f-824a-b04bae0f928a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:42.329910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e2167ce4-0019-483f-824a-b04bae0f928a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.252270 Aug 22 12:47:42.330540 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 69/138] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:42 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:42.395896 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:42.396509 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:42.402491 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:42.402980 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:42.403736 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:42.404128 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:42.404608 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:42.405035 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:42.427897 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e865eea2-96eb-47fc-8258-19e69c1e9f8c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:42.428649 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e865eea2-96eb-47fc-8258-19e69c1e9f8c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:42.435296 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e865eea2-96eb-47fc-8258-19e69c1e9f8c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:42.436296 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e865eea2-96eb-47fc-8258-19e69c1e9f8c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:42.436731 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e865eea2-96eb-47fc-8258-19e69c1e9f8c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:42.437430 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e865eea2-96eb-47fc-8258-19e69c1e9f8c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:42.437884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e865eea2-96eb-47fc-8258-19e69c1e9f8c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:42.440630 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e865eea2-96eb-47fc-8258-19e69c1e9f8c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:42.609003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:42.618474 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:42.619895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:42.621773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a152f16c-9549-4e9e-a960-936e9d715ed8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.229217 Aug 22 12:47:42.621773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 70/139] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:42 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:42.640999 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e865eea2-96eb-47fc-8258-19e69c1e9f8c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:42.648868 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e865eea2-96eb-47fc-8258-19e69c1e9f8c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.224993 Aug 22 12:47:42.649436 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 70/140] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:42 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:43.306064 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-abf072a2-aca2-4b3a-9762-5f2672ca5296 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:43.307181 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-abf072a2-aca2-4b3a-9762-5f2672ca5296 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:43.314168 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-abf072a2-aca2-4b3a-9762-5f2672ca5296 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:43.314707 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-abf072a2-aca2-4b3a-9762-5f2672ca5296 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:43.315160 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-abf072a2-aca2-4b3a-9762-5f2672ca5296 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:43.315832 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-abf072a2-aca2-4b3a-9762-5f2672ca5296 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:43.316286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-abf072a2-aca2-4b3a-9762-5f2672ca5296 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:43.316704 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-abf072a2-aca2-4b3a-9762-5f2672ca5296 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:43.351242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-17cbcee0-e66e-4ee8-96ef-68fb233419e9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:43.352038 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-17cbcee0-e66e-4ee8-96ef-68fb233419e9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:43.363377 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17cbcee0-e66e-4ee8-96ef-68fb233419e9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:43.368684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17cbcee0-e66e-4ee8-96ef-68fb233419e9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:43.369151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17cbcee0-e66e-4ee8-96ef-68fb233419e9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:43.369885 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17cbcee0-e66e-4ee8-96ef-68fb233419e9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:43.370384 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17cbcee0-e66e-4ee8-96ef-68fb233419e9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:43.370821 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17cbcee0-e66e-4ee8-96ef-68fb233419e9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:43.534815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-abf072a2-aca2-4b3a-9762-5f2672ca5296 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:43.541973 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-abf072a2-aca2-4b3a-9762-5f2672ca5296 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.240448 Aug 22 12:47:43.542995 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 71/141] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:43 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:43.557724 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-17cbcee0-e66e-4ee8-96ef-68fb233419e9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:43.566879 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-17cbcee0-e66e-4ee8-96ef-68fb233419e9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.219567 Aug 22 12:47:43.567461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 71/142] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:43 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:43.643010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:43.643613 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:43.649925 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:43.650447 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:43.650920 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:43.651603 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:43.652049 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:43.652471 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:43.670771 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6a754817-d9e9-42f5-9e4c-9da5e27d3c0f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:43.671593 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6a754817-d9e9-42f5-9e4c-9da5e27d3c0f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:43.677676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a754817-d9e9-42f5-9e4c-9da5e27d3c0f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:43.678319 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a754817-d9e9-42f5-9e4c-9da5e27d3c0f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:43.678937 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a754817-d9e9-42f5-9e4c-9da5e27d3c0f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:43.680198 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a754817-d9e9-42f5-9e4c-9da5e27d3c0f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:43.680657 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a754817-d9e9-42f5-9e4c-9da5e27d3c0f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:43.681113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a754817-d9e9-42f5-9e4c-9da5e27d3c0f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:43.865845 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:43.872560 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6a754817-d9e9-42f5-9e4c-9da5e27d3c0f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:43.875325 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:43.877019 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:43.878330 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-fc077b90-76a0-400b-8d0b-ec141991f4ec tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.239727 Aug 22 12:47:43.879212 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 72/143] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:43 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:43.894448 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6a754817-d9e9-42f5-9e4c-9da5e27d3c0f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.227692 Aug 22 12:47:43.895084 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 72/144] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:43 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:44.567096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ed8facba-61ec-4573-8064-dadc5d4fc008 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:44.567704 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ed8facba-61ec-4573-8064-dadc5d4fc008 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:44.573733 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed8facba-61ec-4573-8064-dadc5d4fc008 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:44.574232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed8facba-61ec-4573-8064-dadc5d4fc008 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:44.574660 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed8facba-61ec-4573-8064-dadc5d4fc008 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:44.575372 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed8facba-61ec-4573-8064-dadc5d4fc008 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:44.575896 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed8facba-61ec-4573-8064-dadc5d4fc008 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:44.576320 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed8facba-61ec-4573-8064-dadc5d4fc008 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:44.589662 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-49b7356e-e3aa-491a-80c4-4a5100815473 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:44.591292 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-49b7356e-e3aa-491a-80c4-4a5100815473 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:44.598939 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-49b7356e-e3aa-491a-80c4-4a5100815473 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:44.599639 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-49b7356e-e3aa-491a-80c4-4a5100815473 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:44.600227 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-49b7356e-e3aa-491a-80c4-4a5100815473 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:44.601103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-49b7356e-e3aa-491a-80c4-4a5100815473 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:44.601709 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-49b7356e-e3aa-491a-80c4-4a5100815473 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:44.602328 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-49b7356e-e3aa-491a-80c4-4a5100815473 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:44.953629 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ed8facba-61ec-4573-8064-dadc5d4fc008 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:44.956354 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ed8facba-61ec-4573-8064-dadc5d4fc008 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.392905 Aug 22 12:47:44.970934 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 73/145] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:44 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:44.976085 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:44.976991 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:44.983930 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:44.984609 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:44.985191 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:44.986050 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:44.986572 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:44.987144 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:45.017117 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-49b7356e-e3aa-491a-80c4-4a5100815473 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:45.026809 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-49b7356e-e3aa-491a-80c4-4a5100815473 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.441451 Aug 22 12:47:45.027564 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 73/146] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:44 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:45.035612 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-81ae7f0b-2d45-4bb8-bd07-6d8e8fc00fa8 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:45.036403 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-81ae7f0b-2d45-4bb8-bd07-6d8e8fc00fa8 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:45.052660 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81ae7f0b-2d45-4bb8-bd07-6d8e8fc00fa8 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:45.056579 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81ae7f0b-2d45-4bb8-bd07-6d8e8fc00fa8 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:45.057198 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81ae7f0b-2d45-4bb8-bd07-6d8e8fc00fa8 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:45.058088 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81ae7f0b-2d45-4bb8-bd07-6d8e8fc00fa8 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:45.060122 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81ae7f0b-2d45-4bb8-bd07-6d8e8fc00fa8 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:45.062679 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81ae7f0b-2d45-4bb8-bd07-6d8e8fc00fa8 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:45.182570 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:45.193101 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:45.195497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:45.196922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-218c77b3-40dd-4c4b-9492-c70601167884 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.224760 Aug 22 12:47:45.210522 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 74/147] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:44 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:45.349380 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-81ae7f0b-2d45-4bb8-bd07-6d8e8fc00fa8 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:45.358278 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-81ae7f0b-2d45-4bb8-bd07-6d8e8fc00fa8 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.329331 Aug 22 12:47:45.359067 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 74/148] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:45 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:45.982724 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d2886e0b-a161-41fe-bd8e-c05668d9c389 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:45.982724 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d2886e0b-a161-41fe-bd8e-c05668d9c389 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:45.984074 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2886e0b-a161-41fe-bd8e-c05668d9c389 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:45.984571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2886e0b-a161-41fe-bd8e-c05668d9c389 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:45.985006 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2886e0b-a161-41fe-bd8e-c05668d9c389 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:45.985707 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2886e0b-a161-41fe-bd8e-c05668d9c389 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:45.986196 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2886e0b-a161-41fe-bd8e-c05668d9c389 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:45.986616 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2886e0b-a161-41fe-bd8e-c05668d9c389 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:46.057696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-866bc8c3-96d0-40e8-9937-c666bd1396ca tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:46.059101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-866bc8c3-96d0-40e8-9937-c666bd1396ca tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:46.066451 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866bc8c3-96d0-40e8-9937-c666bd1396ca tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:46.067335 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866bc8c3-96d0-40e8-9937-c666bd1396ca tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:46.067774 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866bc8c3-96d0-40e8-9937-c666bd1396ca tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:46.068548 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866bc8c3-96d0-40e8-9937-c666bd1396ca tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:46.069006 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866bc8c3-96d0-40e8-9937-c666bd1396ca tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:46.069606 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866bc8c3-96d0-40e8-9937-c666bd1396ca tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:46.191420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d2886e0b-a161-41fe-bd8e-c05668d9c389 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:46.201743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d2886e0b-a161-41fe-bd8e-c05668d9c389 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.226811 Aug 22 12:47:46.201743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 75/149] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:45 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:46.225780 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:46.226919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:46.236239 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:46.236881 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:46.237541 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:46.238639 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:46.239333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:46.239979 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:46.244978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-866bc8c3-96d0-40e8-9937-c666bd1396ca tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:46.254559 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-866bc8c3-96d0-40e8-9937-c666bd1396ca tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.204242 Aug 22 12:47:46.255308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 75/150] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:46 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:46.379869 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-304bd1de-8ebf-4dc2-b285-fd3d269d59d1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:46.380488 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-304bd1de-8ebf-4dc2-b285-fd3d269d59d1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:46.381440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:46.386484 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304bd1de-8ebf-4dc2-b285-fd3d269d59d1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:46.386978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304bd1de-8ebf-4dc2-b285-fd3d269d59d1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:46.387415 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304bd1de-8ebf-4dc2-b285-fd3d269d59d1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:46.388116 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304bd1de-8ebf-4dc2-b285-fd3d269d59d1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:46.388576 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304bd1de-8ebf-4dc2-b285-fd3d269d59d1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:46.388999 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304bd1de-8ebf-4dc2-b285-fd3d269d59d1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:46.389829 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:46.391341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:46.392418 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-49fe6f13-5fc6-40b5-bb3f-cdb63977a9ad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.172841 Aug 22 12:47:46.392978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 76/151] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:46 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:47:46.518882 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-304bd1de-8ebf-4dc2-b285-fd3d269d59d1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:46.526527 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-304bd1de-8ebf-4dc2-b285-fd3d269d59d1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.150463 Aug 22 12:47:46.527104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 76/152] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:46 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:47.221581 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a4c5d820-dd1f-4028-a30d-579b245f692e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:47.222331 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a4c5d820-dd1f-4028-a30d-579b245f692e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:47.228318 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a4c5d820-dd1f-4028-a30d-579b245f692e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:47.229109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a4c5d820-dd1f-4028-a30d-579b245f692e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:47.229552 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a4c5d820-dd1f-4028-a30d-579b245f692e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:47.235338 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a4c5d820-dd1f-4028-a30d-579b245f692e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:47.235338 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a4c5d820-dd1f-4028-a30d-579b245f692e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:47.235338 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a4c5d820-dd1f-4028-a30d-579b245f692e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:47.279865 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-53ce44f7-583e-4a6c-91cf-d6a37c087308 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:47.279865 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-53ce44f7-583e-4a6c-91cf-d6a37c087308 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:47.283251 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ce44f7-583e-4a6c-91cf-d6a37c087308 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:47.283871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ce44f7-583e-4a6c-91cf-d6a37c087308 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:47.284310 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ce44f7-583e-4a6c-91cf-d6a37c087308 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:47.285007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ce44f7-583e-4a6c-91cf-d6a37c087308 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:47.285460 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ce44f7-583e-4a6c-91cf-d6a37c087308 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:47.286107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ce44f7-583e-4a6c-91cf-d6a37c087308 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:47.401875 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a4c5d820-dd1f-4028-a30d-579b245f692e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:47.410611 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a4c5d820-dd1f-4028-a30d-579b245f692e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.193463 Aug 22 12:47:47.424050 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 77/153] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:47 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:47.424050 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:47.424050 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:47.425704 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:47.430283 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:47.430283 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:47.430283 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:47.430283 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:47.430590 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:47.452058 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-53ce44f7-583e-4a6c-91cf-d6a37c087308 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:47.461562 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-53ce44f7-583e-4a6c-91cf-d6a37c087308 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.189859 Aug 22 12:47:47.462204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 77/154] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:47 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:47.548401 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-154ca097-f71e-4ddd-b4a9-6cf99d08372c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:47.549425 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-154ca097-f71e-4ddd-b4a9-6cf99d08372c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:47.558647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-154ca097-f71e-4ddd-b4a9-6cf99d08372c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:47.559134 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-154ca097-f71e-4ddd-b4a9-6cf99d08372c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:47.560424 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-154ca097-f71e-4ddd-b4a9-6cf99d08372c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:47.561130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-154ca097-f71e-4ddd-b4a9-6cf99d08372c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:47.562045 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-154ca097-f71e-4ddd-b4a9-6cf99d08372c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:47.562045 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-154ca097-f71e-4ddd-b4a9-6cf99d08372c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:47.574302 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=100 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:47.611796 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:47.617217 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:47.619087 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:47.620648 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-32cf1981-28b0-4595-b4b6-15098628789b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.207846 Aug 22 12:47:47.627779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 78/155] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:47 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:47.705813 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-b69e7ddc-5117-445c-9025-53ff7c75ac98 req-828fe50f-d3dd-4ee5-b53a-d687561b01db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d3d67d-bb7d-4e73-961f-a359e2954db9", "name": "network-vif-plugged", "status": "completed", "tag": "fcd8ebaa-5021-4d67-8795-1b1b3e62f91d"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:47.717300 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b69e7ddc-5117-445c-9025-53ff7c75ac98 req-828fe50f-d3dd-4ee5-b53a-d687561b01db service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:47.717300 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b69e7ddc-5117-445c-9025-53ff7c75ac98 req-828fe50f-d3dd-4ee5-b53a-d687561b01db service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:47.717300 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b69e7ddc-5117-445c-9025-53ff7c75ac98 req-828fe50f-d3dd-4ee5-b53a-d687561b01db service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:47.721497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=100 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:47.729534 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-b69e7ddc-5117-445c-9025-53ff7c75ac98 req-828fe50f-d3dd-4ee5-b53a-d687561b01db service nova] Creating event network-vif-plugged:fcd8ebaa-5021-4d67-8795-1b1b3e62f91d for instance 08d3d67d-bb7d-4e73-961f-a359e2954db9 on hv-cinder-85083 Aug 22 12:47:47.735463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-b69e7ddc-5117-445c-9025-53ff7c75ac98 req-828fe50f-d3dd-4ee5-b53a-d687561b01db service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033304 Aug 22 12:47:47.736577 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 79/156] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:47:47.757601 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-154ca097-f71e-4ddd-b4a9-6cf99d08372c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:47.762206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-154ca097-f71e-4ddd-b4a9-6cf99d08372c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.218668 Aug 22 12:47:47.762870 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 78/157] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:47 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:48.433759 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3bed8254-39f4-4e32-b59f-3879b7ed7c0a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:48.434674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3bed8254-39f4-4e32-b59f-3879b7ed7c0a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:48.442133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3bed8254-39f4-4e32-b59f-3879b7ed7c0a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:48.442655 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3bed8254-39f4-4e32-b59f-3879b7ed7c0a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:48.443087 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3bed8254-39f4-4e32-b59f-3879b7ed7c0a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:48.443865 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3bed8254-39f4-4e32-b59f-3879b7ed7c0a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:48.444209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3bed8254-39f4-4e32-b59f-3879b7ed7c0a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:48.444765 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3bed8254-39f4-4e32-b59f-3879b7ed7c0a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:48.484202 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e9aa795b-16bd-4995-be72-6ea057d4f1da tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:48.485007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e9aa795b-16bd-4995-be72-6ea057d4f1da tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:48.491354 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9aa795b-16bd-4995-be72-6ea057d4f1da tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:48.491932 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9aa795b-16bd-4995-be72-6ea057d4f1da tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:48.492440 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9aa795b-16bd-4995-be72-6ea057d4f1da tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:48.493231 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9aa795b-16bd-4995-be72-6ea057d4f1da tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:48.493766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9aa795b-16bd-4995-be72-6ea057d4f1da tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:48.494293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9aa795b-16bd-4995-be72-6ea057d4f1da tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:48.630600 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3bed8254-39f4-4e32-b59f-3879b7ed7c0a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:48.639638 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3bed8254-39f4-4e32-b59f-3879b7ed7c0a tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.211328 Aug 22 12:47:48.640743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 80/158] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:48 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:48.646585 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:48.647399 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:48.653354 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:48.654723 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:48.655318 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:48.656013 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:48.661024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:48.661024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:48.666446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e9aa795b-16bd-4995-be72-6ea057d4f1da tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:48.674463 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e9aa795b-16bd-4995-be72-6ea057d4f1da tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.196002 Aug 22 12:47:48.685965 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 79/159] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:48 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:48.783132 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-363f84c4-c34a-4bc5-b5d5-01f125c0d72d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:48.783865 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-363f84c4-c34a-4bc5-b5d5-01f125c0d72d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:48.800806 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:48.806071 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-363f84c4-c34a-4bc5-b5d5-01f125c0d72d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:48.807693 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-363f84c4-c34a-4bc5-b5d5-01f125c0d72d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:48.809482 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-363f84c4-c34a-4bc5-b5d5-01f125c0d72d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:48.810371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-363f84c4-c34a-4bc5-b5d5-01f125c0d72d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:48.812694 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:48.813209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-363f84c4-c34a-4bc5-b5d5-01f125c0d72d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:48.813732 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-363f84c4-c34a-4bc5-b5d5-01f125c0d72d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:48.822042 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:48.823227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0b559ed6-c838-4d05-809e-917dcf9961b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.181392 Aug 22 12:47:48.824326 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 81/160] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:48 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:48.971809 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-363f84c4-c34a-4bc5-b5d5-01f125c0d72d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:48.980124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-363f84c4-c34a-4bc5-b5d5-01f125c0d72d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.201200 Aug 22 12:47:48.980689 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 80/161] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:48 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:49.660423 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0be9e046-ce78-48b7-a7c8-230cdae793c9 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:49.661039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0be9e046-ce78-48b7-a7c8-230cdae793c9 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:49.667099 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0be9e046-ce78-48b7-a7c8-230cdae793c9 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:49.667615 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0be9e046-ce78-48b7-a7c8-230cdae793c9 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:49.668058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0be9e046-ce78-48b7-a7c8-230cdae793c9 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:49.668755 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0be9e046-ce78-48b7-a7c8-230cdae793c9 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:49.669219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0be9e046-ce78-48b7-a7c8-230cdae793c9 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:49.670206 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0be9e046-ce78-48b7-a7c8-230cdae793c9 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:49.695686 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-80c7fb72-0586-46a7-b246-420c46f1b22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:49.696504 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-80c7fb72-0586-46a7-b246-420c46f1b22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:49.702585 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-80c7fb72-0586-46a7-b246-420c46f1b22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:49.703244 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-80c7fb72-0586-46a7-b246-420c46f1b22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:49.703685 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-80c7fb72-0586-46a7-b246-420c46f1b22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:49.704475 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-80c7fb72-0586-46a7-b246-420c46f1b22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:49.704937 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-80c7fb72-0586-46a7-b246-420c46f1b22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:49.705362 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-80c7fb72-0586-46a7-b246-420c46f1b22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:49.891131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0be9e046-ce78-48b7-a7c8-230cdae793c9 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:49.895759 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-80c7fb72-0586-46a7-b246-420c46f1b22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:49.903780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-80c7fb72-0586-46a7-b246-420c46f1b22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1321 microversion: 2.1 time: 0.211999 Aug 22 12:47:49.904953 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 81/162] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:49 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:49.908459 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0be9e046-ce78-48b7-a7c8-230cdae793c9 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.251761 Aug 22 12:47:49.909099 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 82/163] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:49 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:49.909367 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-d4be9537-091c-4f4e-bcae-812cfc6fd140 req-bcff0abd-ad3d-4092-a0f0-f90ef445545e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e060778-7e35-44e9-99f4-f2fb64f07928", "name": "network-vif-plugged", "status": "completed", "tag": "b8fb88da-a096-4c45-bd62-6606ee956319"}, {"server_uuid": "3c28a24f-c2f3-412a-9d9b-b152e4407042", "name": "network-vif-plugged", "status": "completed", "tag": "0be03a40-3f02-4195-8045-9ce908e5f55e"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:49.914411 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:49.915244 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:49.922763 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:49.923570 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:49.924209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:49.925039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:49.925716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:49.926469 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:49.929852 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d4be9537-091c-4f4e-bcae-812cfc6fd140 req-bcff0abd-ad3d-4092-a0f0-f90ef445545e service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:49.931941 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d4be9537-091c-4f4e-bcae-812cfc6fd140 req-bcff0abd-ad3d-4092-a0f0-f90ef445545e service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:49.938423 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d4be9537-091c-4f4e-bcae-812cfc6fd140 req-bcff0abd-ad3d-4092-a0f0-f90ef445545e service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:49.949384 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-d4be9537-091c-4f4e-bcae-812cfc6fd140 req-bcff0abd-ad3d-4092-a0f0-f90ef445545e service nova] Creating event network-vif-plugged:b8fb88da-a096-4c45-bd62-6606ee956319 for instance 4e060778-7e35-44e9-99f4-f2fb64f07928 on hv-cinder-85083 Aug 22 12:47:49.949989 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-d4be9537-091c-4f4e-bcae-812cfc6fd140 req-bcff0abd-ad3d-4092-a0f0-f90ef445545e service nova] Creating event network-vif-plugged:0be03a40-3f02-4195-8045-9ce908e5f55e for instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 on hv-cinder-85083 Aug 22 12:47:49.957541 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-d4be9537-091c-4f4e-bcae-812cfc6fd140 req-bcff0abd-ad3d-4092-a0f0-f90ef445545e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051430 Aug 22 12:47:49.958267 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 82/164] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:50.002742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-786acd95-747d-474c-9ceb-091899bc8274 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:50.003645 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-786acd95-747d-474c-9ceb-091899bc8274 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:50.012485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-786acd95-747d-474c-9ceb-091899bc8274 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:50.013096 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-786acd95-747d-474c-9ceb-091899bc8274 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:50.013438 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-786acd95-747d-474c-9ceb-091899bc8274 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:50.015056 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-786acd95-747d-474c-9ceb-091899bc8274 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:50.015668 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-786acd95-747d-474c-9ceb-091899bc8274 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:50.016238 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-786acd95-747d-474c-9ceb-091899bc8274 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:50.224068 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:50.252465 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:50.255670 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:50.259130 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-747937d9-20df-4831-8268-4dc86b8622b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.348722 Aug 22 12:47:50.259901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 83/165] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:49 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:50.326620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-786acd95-747d-474c-9ceb-091899bc8274 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:50.335190 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-786acd95-747d-474c-9ceb-091899bc8274 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.337862 Aug 22 12:47:50.336243 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 83/166] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:49 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:50.924759 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-9088d534-7e45-4724-a39d-71f4c1bad8b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:50.925329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-9088d534-7e45-4724-a39d-71f4c1bad8b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:50.931379 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9088d534-7e45-4724-a39d-71f4c1bad8b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:50.931865 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9088d534-7e45-4724-a39d-71f4c1bad8b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:50.932299 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9088d534-7e45-4724-a39d-71f4c1bad8b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:50.932990 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9088d534-7e45-4724-a39d-71f4c1bad8b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:50.933439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9088d534-7e45-4724-a39d-71f4c1bad8b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:50.933864 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9088d534-7e45-4724-a39d-71f4c1bad8b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:50.935652 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-db10d929-bd84-4111-96dc-eb2491716eca tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:50.936395 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-db10d929-bd84-4111-96dc-eb2491716eca tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:50.942462 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db10d929-bd84-4111-96dc-eb2491716eca tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:50.942941 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db10d929-bd84-4111-96dc-eb2491716eca tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:50.943368 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db10d929-bd84-4111-96dc-eb2491716eca tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:50.944053 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db10d929-bd84-4111-96dc-eb2491716eca tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:50.944502 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db10d929-bd84-4111-96dc-eb2491716eca tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:50.944921 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db10d929-bd84-4111-96dc-eb2491716eca tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:51.142335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9088d534-7e45-4724-a39d-71f4c1bad8b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:51.145103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-db10d929-bd84-4111-96dc-eb2491716eca tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:51.151542 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-9088d534-7e45-4724-a39d-71f4c1bad8b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1514 microversion: 2.1 time: 0.230542 Aug 22 12:47:51.154783 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-db10d929-bd84-4111-96dc-eb2491716eca tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.222623 Aug 22 12:47:51.155720 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 84/167] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:50 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:51.161905 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 84/168] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:50 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:51.173201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-33794f7a-605f-4e91-8d88-b573a7bd3ae1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:51.176049 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-33794f7a-605f-4e91-8d88-b573a7bd3ae1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:51.179323 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=100 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:51.182731 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33794f7a-605f-4e91-8d88-b573a7bd3ae1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:51.183214 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33794f7a-605f-4e91-8d88-b573a7bd3ae1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:51.183812 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33794f7a-605f-4e91-8d88-b573a7bd3ae1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:51.184624 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33794f7a-605f-4e91-8d88-b573a7bd3ae1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:51.184965 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33794f7a-605f-4e91-8d88-b573a7bd3ae1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:51.186027 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33794f7a-605f-4e91-8d88-b573a7bd3ae1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:51.248996 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-33794f7a-605f-4e91-8d88-b573a7bd3ae1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lazy-loading 'flavor' on Instance uuid 08d3d67d-bb7d-4e73-961f-a359e2954db9 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:47:51.290223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:51.291334 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:51.297837 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:51.298605 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:51.299041 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:51.299931 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:51.300402 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:51.300835 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:51.504824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:51.516467 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:51.519343 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:51.520806 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1708f181-5230-4f24-b768-b5acba1d0832 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1408 microversion: 2.20 time: 0.240098 Aug 22 12:47:51.521623 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 85/169] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:51 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:47:51.527441 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e8841bd5-5154-4073-90c8-75b9f2940905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:51.528289 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e8841bd5-5154-4073-90c8-75b9f2940905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:51.540133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8841bd5-5154-4073-90c8-75b9f2940905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:51.540629 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8841bd5-5154-4073-90c8-75b9f2940905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:51.543958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8841bd5-5154-4073-90c8-75b9f2940905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:51.543958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8841bd5-5154-4073-90c8-75b9f2940905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:51.543958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8841bd5-5154-4073-90c8-75b9f2940905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:51.543958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8841bd5-5154-4073-90c8-75b9f2940905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:51.666968 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-33794f7a-605f-4e91-8d88-b573a7bd3ae1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "POST /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9/action" status: 200 len: 32 microversion: 2.1 time: 0.498233 Aug 22 12:47:51.667573 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 85/170] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 12:47:51 2022] POST /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9/action => generated 32 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 12:47:51.679425 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d5a167de-b7d0-4bea-8751-d14816d09c0e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:51.680145 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-d5a167de-b7d0-4bea-8751-d14816d09c0e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:51.688006 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5a167de-b7d0-4bea-8751-d14816d09c0e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:51.688506 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5a167de-b7d0-4bea-8751-d14816d09c0e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:51.688950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5a167de-b7d0-4bea-8751-d14816d09c0e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:51.689662 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5a167de-b7d0-4bea-8751-d14816d09c0e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:51.690123 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5a167de-b7d0-4bea-8751-d14816d09c0e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:51.690774 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5a167de-b7d0-4bea-8751-d14816d09c0e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:51.808480 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e8841bd5-5154-4073-90c8-75b9f2940905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:51.829716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e8841bd5-5154-4073-90c8-75b9f2940905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.305953 Aug 22 12:47:51.831159 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 86/171] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:51 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:51.883483 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d5a167de-b7d0-4bea-8751-d14816d09c0e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:51.893535 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d5a167de-b7d0-4bea-8751-d14816d09c0e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.219035 Aug 22 12:47:51.894881 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 86/172] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:51 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:52.001286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-7395391c-7860-4ceb-a07c-dfef26eba355 req-234e0ef0-940d-49d5-af0c-084e81aea518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48cd5dbe-4358-40f8-9515-87434787eca4", "name": "network-vif-plugged", "status": "completed", "tag": "5e8ad75e-fce7-4867-9eae-2924ebf24649"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:52.016878 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-7395391c-7860-4ceb-a07c-dfef26eba355 req-234e0ef0-940d-49d5-af0c-084e81aea518 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:52.017648 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-7395391c-7860-4ceb-a07c-dfef26eba355 req-234e0ef0-940d-49d5-af0c-084e81aea518 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:52.018403 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-7395391c-7860-4ceb-a07c-dfef26eba355 req-234e0ef0-940d-49d5-af0c-084e81aea518 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:52.058675 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-7395391c-7860-4ceb-a07c-dfef26eba355 req-234e0ef0-940d-49d5-af0c-084e81aea518 service nova] Creating event network-vif-plugged:5e8ad75e-fce7-4867-9eae-2924ebf24649 for instance 48cd5dbe-4358-40f8-9515-87434787eca4 on hv-cinder-85083 Aug 22 12:47:52.069945 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-7395391c-7860-4ceb-a07c-dfef26eba355 req-234e0ef0-940d-49d5-af0c-084e81aea518 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077414 Aug 22 12:47:52.070853 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 87/173] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:52.176310 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3aeff0f5-534a-40f3-a3b1-bb5273e7789e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:52.177049 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-3aeff0f5-534a-40f3-a3b1-bb5273e7789e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:52.183550 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3aeff0f5-534a-40f3-a3b1-bb5273e7789e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:52.184277 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3aeff0f5-534a-40f3-a3b1-bb5273e7789e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:52.184719 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3aeff0f5-534a-40f3-a3b1-bb5273e7789e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:52.185461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3aeff0f5-534a-40f3-a3b1-bb5273e7789e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:52.185930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3aeff0f5-534a-40f3-a3b1-bb5273e7789e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:52.186393 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3aeff0f5-534a-40f3-a3b1-bb5273e7789e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:52.335434 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3aeff0f5-534a-40f3-a3b1-bb5273e7789e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:52.345830 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-3aeff0f5-534a-40f3-a3b1-bb5273e7789e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1315 microversion: 2.1 time: 0.173218 Aug 22 12:47:52.346732 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 87/174] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:52 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:52.544327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:52.545054 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:52.551122 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:52.551601 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:52.552035 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:52.552782 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:52.553229 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:52.553653 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:52.684084 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:52.693882 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:52.695435 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:52.696591 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b37159b3-fbcf-4809-9352-d1c883374c28 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1600 microversion: 2.20 time: 0.156574 Aug 22 12:47:52.697144 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 88/175] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:47:52 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:47:52.720054 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a3bb55f8-da4a-4e39-b6c8-002c50e0c23a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:52.720539 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a3bb55f8-da4a-4e39-b6c8-002c50e0c23a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:52.726647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3bb55f8-da4a-4e39-b6c8-002c50e0c23a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:52.727643 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3bb55f8-da4a-4e39-b6c8-002c50e0c23a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:52.727643 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3bb55f8-da4a-4e39-b6c8-002c50e0c23a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:52.728300 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3bb55f8-da4a-4e39-b6c8-002c50e0c23a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:52.729023 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3bb55f8-da4a-4e39-b6c8-002c50e0c23a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:52.729429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3bb55f8-da4a-4e39-b6c8-002c50e0c23a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:52.825702 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a3bb55f8-da4a-4e39-b6c8-002c50e0c23a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.109708 Aug 22 12:47:52.827063 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 88/176] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Aug 22 12:47:52 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:47:52.851904 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7eccc78e-2d9a-481c-a69d-7ad4b48d70af tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:52.856017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7eccc78e-2d9a-481c-a69d-7ad4b48d70af tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:52.860016 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7eccc78e-2d9a-481c-a69d-7ad4b48d70af tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:52.860901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7eccc78e-2d9a-481c-a69d-7ad4b48d70af tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:52.861532 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7eccc78e-2d9a-481c-a69d-7ad4b48d70af tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:52.862824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7eccc78e-2d9a-481c-a69d-7ad4b48d70af tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:52.863492 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7eccc78e-2d9a-481c-a69d-7ad4b48d70af tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:52.864102 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7eccc78e-2d9a-481c-a69d-7ad4b48d70af tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:52.916125 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e97a26a0-2c11-425d-bb8e-9c1ae6e99931 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:52.916835 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e97a26a0-2c11-425d-bb8e-9c1ae6e99931 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:52.926315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e97a26a0-2c11-425d-bb8e-9c1ae6e99931 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:52.927081 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e97a26a0-2c11-425d-bb8e-9c1ae6e99931 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:52.927924 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e97a26a0-2c11-425d-bb8e-9c1ae6e99931 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:52.928912 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e97a26a0-2c11-425d-bb8e-9c1ae6e99931 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:52.930779 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e97a26a0-2c11-425d-bb8e-9c1ae6e99931 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:52.934536 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e97a26a0-2c11-425d-bb8e-9c1ae6e99931 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:53.178554 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7eccc78e-2d9a-481c-a69d-7ad4b48d70af tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:53.188392 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7eccc78e-2d9a-481c-a69d-7ad4b48d70af tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.340738 Aug 22 12:47:53.188983 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 89/177] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:52 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:53.213355 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e97a26a0-2c11-425d-bb8e-9c1ae6e99931 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:53.222628 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e97a26a0-2c11-425d-bb8e-9c1ae6e99931 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.311424 Aug 22 12:47:53.234377 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 89/178] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:52 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:53.367447 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0faffd6b-c580-4002-95a9-1220f1f66f95 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:53.368524 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0faffd6b-c580-4002-95a9-1220f1f66f95 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:53.375383 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0faffd6b-c580-4002-95a9-1220f1f66f95 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:53.376175 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0faffd6b-c580-4002-95a9-1220f1f66f95 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:53.376683 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0faffd6b-c580-4002-95a9-1220f1f66f95 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:53.377451 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0faffd6b-c580-4002-95a9-1220f1f66f95 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:53.378106 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0faffd6b-c580-4002-95a9-1220f1f66f95 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:53.378652 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0faffd6b-c580-4002-95a9-1220f1f66f95 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:53.540798 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0faffd6b-c580-4002-95a9-1220f1f66f95 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:53.552265 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0faffd6b-c580-4002-95a9-1220f1f66f95 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1502 microversion: 2.1 time: 0.188696 Aug 22 12:47:53.552862 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 90/179] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:53 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:54.211169 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c55facf7-6d10-4966-aebc-17bfae9f3022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:54.212080 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c55facf7-6d10-4966-aebc-17bfae9f3022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:54.223951 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c55facf7-6d10-4966-aebc-17bfae9f3022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:54.225089 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c55facf7-6d10-4966-aebc-17bfae9f3022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:54.225824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c55facf7-6d10-4966-aebc-17bfae9f3022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:54.227387 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c55facf7-6d10-4966-aebc-17bfae9f3022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:54.228014 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c55facf7-6d10-4966-aebc-17bfae9f3022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:54.228950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c55facf7-6d10-4966-aebc-17bfae9f3022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:54.251106 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8e1634d7-1827-458e-b15a-4d13435fa9a8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:54.251833 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8e1634d7-1827-458e-b15a-4d13435fa9a8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:54.263996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e1634d7-1827-458e-b15a-4d13435fa9a8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:54.264501 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e1634d7-1827-458e-b15a-4d13435fa9a8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:54.267158 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e1634d7-1827-458e-b15a-4d13435fa9a8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:54.267450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e1634d7-1827-458e-b15a-4d13435fa9a8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:54.267955 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e1634d7-1827-458e-b15a-4d13435fa9a8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:54.268383 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e1634d7-1827-458e-b15a-4d13435fa9a8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:54.518137 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c55facf7-6d10-4966-aebc-17bfae9f3022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:54.529785 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c55facf7-6d10-4966-aebc-17bfae9f3022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.324103 Aug 22 12:47:54.530408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 90/180] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:54 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:54.584276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8e1634d7-1827-458e-b15a-4d13435fa9a8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:54.601922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8e1634d7-1827-458e-b15a-4d13435fa9a8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.354762 Aug 22 12:47:54.601922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 91/181] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:54 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:54.730550 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-498c5717-fa71-4006-9f42-eed92233e72d req-e751b6d4-1026-44fe-a962-b61f72ca058f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e060778-7e35-44e9-99f4-f2fb64f07928", "tag": "b8fb88da-a096-4c45-bd62-6606ee956319"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:54.741135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-498c5717-fa71-4006-9f42-eed92233e72d req-e751b6d4-1026-44fe-a962-b61f72ca058f service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:54.741784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-498c5717-fa71-4006-9f42-eed92233e72d req-e751b6d4-1026-44fe-a962-b61f72ca058f service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:54.742563 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-498c5717-fa71-4006-9f42-eed92233e72d req-e751b6d4-1026-44fe-a962-b61f72ca058f service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:54.755889 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-498c5717-fa71-4006-9f42-eed92233e72d req-e751b6d4-1026-44fe-a962-b61f72ca058f service nova] Creating event network-changed:b8fb88da-a096-4c45-bd62-6606ee956319 for instance 4e060778-7e35-44e9-99f4-f2fb64f07928 on hv-cinder-85083 Aug 22 12:47:54.762694 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-498c5717-fa71-4006-9f42-eed92233e72d req-e751b6d4-1026-44fe-a962-b61f72ca058f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034756 Aug 22 12:47:54.762694 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 91/182] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:55.521481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d06f9fcd-2abf-41ee-8ba5-b06ee4c3429e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3eb7fd83-be1d-4626-93c7-21e2cddba85d"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:55.524014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d06f9fcd-2abf-41ee-8ba5-b06ee4c3429e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:55.530052 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d06f9fcd-2abf-41ee-8ba5-b06ee4c3429e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:55.531090 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d06f9fcd-2abf-41ee-8ba5-b06ee4c3429e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:55.534394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d06f9fcd-2abf-41ee-8ba5-b06ee4c3429e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:55.534394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d06f9fcd-2abf-41ee-8ba5-b06ee4c3429e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:55.534394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d06f9fcd-2abf-41ee-8ba5-b06ee4c3429e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:55.534394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d06f9fcd-2abf-41ee-8ba5-b06ee4c3429e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:55.551499 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-17393144-fc5f-4bed-b13a-4123b0e21170 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:55.552203 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-17393144-fc5f-4bed-b13a-4123b0e21170 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:55.558476 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17393144-fc5f-4bed-b13a-4123b0e21170 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:55.558960 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17393144-fc5f-4bed-b13a-4123b0e21170 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:55.559570 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17393144-fc5f-4bed-b13a-4123b0e21170 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:55.560827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17393144-fc5f-4bed-b13a-4123b0e21170 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:55.561284 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17393144-fc5f-4bed-b13a-4123b0e21170 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:55.561702 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-17393144-fc5f-4bed-b13a-4123b0e21170 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:56.068915 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-17393144-fc5f-4bed-b13a-4123b0e21170 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:56.077623 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-17393144-fc5f-4bed-b13a-4123b0e21170 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1363 microversion: 2.1 time: 0.530294 Aug 22 12:47:56.078224 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 92/183] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:55 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1363 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:56.087552 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-debe79d1-b088-4449-8c15-2d5daaad0f1d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:56.088159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-debe79d1-b088-4449-8c15-2d5daaad0f1d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:56.095829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debe79d1-b088-4449-8c15-2d5daaad0f1d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:56.096489 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debe79d1-b088-4449-8c15-2d5daaad0f1d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:56.097153 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debe79d1-b088-4449-8c15-2d5daaad0f1d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:56.098658 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debe79d1-b088-4449-8c15-2d5daaad0f1d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:56.099186 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debe79d1-b088-4449-8c15-2d5daaad0f1d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:56.099673 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debe79d1-b088-4449-8c15-2d5daaad0f1d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:56.334441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-debe79d1-b088-4449-8c15-2d5daaad0f1d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:56.343230 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-debe79d1-b088-4449-8c15-2d5daaad0f1d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.259546 Aug 22 12:47:56.343816 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 93/184] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:56 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:56.948577 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d06f9fcd-2abf-41ee-8ba5-b06ee4c3429e tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "POST /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.432741 Aug 22 12:47:56.949226 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 92/185] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:47:55 2022] POST /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042/os-volume_attachments => generated 194 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:57.109496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e6e61e86-3c40-4a9e-841e-44f7d0563cf2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:57.110230 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e6e61e86-3c40-4a9e-841e-44f7d0563cf2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:57.116394 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e6e61e86-3c40-4a9e-841e-44f7d0563cf2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:57.116876 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e6e61e86-3c40-4a9e-841e-44f7d0563cf2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:57.117316 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e6e61e86-3c40-4a9e-841e-44f7d0563cf2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:57.118026 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e6e61e86-3c40-4a9e-841e-44f7d0563cf2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:57.118541 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e6e61e86-3c40-4a9e-841e-44f7d0563cf2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:57.119158 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e6e61e86-3c40-4a9e-841e-44f7d0563cf2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:57.140369 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:57.305680 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e6e61e86-3c40-4a9e-841e-44f7d0563cf2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:57.316969 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e6e61e86-3c40-4a9e-841e-44f7d0563cf2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1549 microversion: 2.1 time: 0.222235 Aug 22 12:47:57.317858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 94/186] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:57 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1549 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:57.339202 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ca703259-366a-4599-a957-bc710e09e300 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:57.339861 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ca703259-366a-4599-a957-bc710e09e300 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:57.343083 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=99 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:57.348117 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca703259-366a-4599-a957-bc710e09e300 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:57.348607 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca703259-366a-4599-a957-bc710e09e300 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:57.349209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca703259-366a-4599-a957-bc710e09e300 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:57.349906 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca703259-366a-4599-a957-bc710e09e300 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:57.350409 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca703259-366a-4599-a957-bc710e09e300 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:57.350833 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca703259-366a-4599-a957-bc710e09e300 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:57.364815 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-78b9e755-298b-4922-a838-839617d318d2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:57.365542 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-78b9e755-298b-4922-a838-839617d318d2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:57.371567 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78b9e755-298b-4922-a838-839617d318d2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:57.372132 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78b9e755-298b-4922-a838-839617d318d2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:57.373145 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78b9e755-298b-4922-a838-839617d318d2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:57.373899 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78b9e755-298b-4922-a838-839617d318d2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:57.374454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78b9e755-298b-4922-a838-839617d318d2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:57.374966 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78b9e755-298b-4922-a838-839617d318d2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:57.479818 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ca703259-366a-4599-a957-bc710e09e300 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143717 Aug 22 12:47:57.480523 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 93/187] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 22 12:47:57 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:57.563794 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-78b9e755-298b-4922-a838-839617d318d2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:57.572099 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-78b9e755-298b-4922-a838-839617d318d2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.211119 Aug 22 12:47:57.572776 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 95/188] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:57 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:47:58.593745 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-eb976b41-1e5d-465f-9b65-832bf992fbe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:58.594639 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-eb976b41-1e5d-465f-9b65-832bf992fbe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:58.604015 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eb976b41-1e5d-465f-9b65-832bf992fbe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:58.604826 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eb976b41-1e5d-465f-9b65-832bf992fbe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:58.605569 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eb976b41-1e5d-465f-9b65-832bf992fbe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:58.606473 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eb976b41-1e5d-465f-9b65-832bf992fbe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:58.607426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eb976b41-1e5d-465f-9b65-832bf992fbe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:58.607857 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eb976b41-1e5d-465f-9b65-832bf992fbe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:58.610716 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-f3e61db7-9a91-4d1f-a60d-0e4bcf078008 req-263538cc-70ad-4276-b228-9091fd0c36f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48cd5dbe-4358-40f8-9515-87434787eca4", "tag": "5e8ad75e-fce7-4867-9eae-2924ebf24649"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:47:58.620569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-f3e61db7-9a91-4d1f-a60d-0e4bcf078008 req-263538cc-70ad-4276-b228-9091fd0c36f5 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:58.621116 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-f3e61db7-9a91-4d1f-a60d-0e4bcf078008 req-263538cc-70ad-4276-b228-9091fd0c36f5 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:58.621704 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-f3e61db7-9a91-4d1f-a60d-0e4bcf078008 req-263538cc-70ad-4276-b228-9091fd0c36f5 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:58.635599 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-f3e61db7-9a91-4d1f-a60d-0e4bcf078008 req-263538cc-70ad-4276-b228-9091fd0c36f5 service nova] Creating event network-changed:5e8ad75e-fce7-4867-9eae-2924ebf24649 for instance 48cd5dbe-4358-40f8-9515-87434787eca4 on hv-cinder-85083 Aug 22 12:47:58.641858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-f3e61db7-9a91-4d1f-a60d-0e4bcf078008 req-263538cc-70ad-4276-b228-9091fd0c36f5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035666 Aug 22 12:47:58.643073 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 96/189] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:47:58.783651 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-eb976b41-1e5d-465f-9b65-832bf992fbe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:58.792027 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-eb976b41-1e5d-465f-9b65-832bf992fbe8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.202839 Aug 22 12:47:58.792919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 94/190] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:58 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:47:59.813287 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-729c8146-ba28-4ea6-861f-7cef5d43de9e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:47:59.813986 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-729c8146-ba28-4ea6-861f-7cef5d43de9e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:47:59.820698 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-729c8146-ba28-4ea6-861f-7cef5d43de9e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:59.821187 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-729c8146-ba28-4ea6-861f-7cef5d43de9e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:59.821624 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-729c8146-ba28-4ea6-861f-7cef5d43de9e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:59.822340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-729c8146-ba28-4ea6-861f-7cef5d43de9e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:47:59.822842 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-729c8146-ba28-4ea6-861f-7cef5d43de9e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:47:59.823231 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-729c8146-ba28-4ea6-861f-7cef5d43de9e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:47:59.974929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-729c8146-ba28-4ea6-861f-7cef5d43de9e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:47:59.986168 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-729c8146-ba28-4ea6-861f-7cef5d43de9e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.176750 Aug 22 12:47:59.986610 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 97/191] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:47:59 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:01.012798 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-85750bd6-d8f1-41cd-adf5-84b72a671f13 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:01.013424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-85750bd6-d8f1-41cd-adf5-84b72a671f13 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:01.020162 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-85750bd6-d8f1-41cd-adf5-84b72a671f13 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:01.020640 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-85750bd6-d8f1-41cd-adf5-84b72a671f13 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:01.021256 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-85750bd6-d8f1-41cd-adf5-84b72a671f13 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:01.021953 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-85750bd6-d8f1-41cd-adf5-84b72a671f13 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:01.022429 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-85750bd6-d8f1-41cd-adf5-84b72a671f13 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:01.022854 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-85750bd6-d8f1-41cd-adf5-84b72a671f13 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:01.156175 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-85750bd6-d8f1-41cd-adf5-84b72a671f13 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:01.164946 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-85750bd6-d8f1-41cd-adf5-84b72a671f13 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.155894 Aug 22 12:48:01.165662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 95/192] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:01 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:02.189590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1b3c4b15-b7df-4da7-a4ec-44b53f0dd971 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:02.190272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1b3c4b15-b7df-4da7-a4ec-44b53f0dd971 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:02.199701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b3c4b15-b7df-4da7-a4ec-44b53f0dd971 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:02.200793 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b3c4b15-b7df-4da7-a4ec-44b53f0dd971 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:02.201180 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b3c4b15-b7df-4da7-a4ec-44b53f0dd971 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:02.202069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b3c4b15-b7df-4da7-a4ec-44b53f0dd971 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:02.204813 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b3c4b15-b7df-4da7-a4ec-44b53f0dd971 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:02.205576 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b3c4b15-b7df-4da7-a4ec-44b53f0dd971 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:02.374437 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1b3c4b15-b7df-4da7-a4ec-44b53f0dd971 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:02.382230 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1b3c4b15-b7df-4da7-a4ec-44b53f0dd971 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.199437 Aug 22 12:48:02.382795 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 98/193] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:02 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:03.410520 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7b783721-5ea8-4399-b5a9-b6a8da9fcb34 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:03.411155 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7b783721-5ea8-4399-b5a9-b6a8da9fcb34 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:03.422395 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b783721-5ea8-4399-b5a9-b6a8da9fcb34 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:03.423161 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b783721-5ea8-4399-b5a9-b6a8da9fcb34 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:03.424288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b783721-5ea8-4399-b5a9-b6a8da9fcb34 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:03.424466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b783721-5ea8-4399-b5a9-b6a8da9fcb34 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:03.425071 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b783721-5ea8-4399-b5a9-b6a8da9fcb34 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:03.425646 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b783721-5ea8-4399-b5a9-b6a8da9fcb34 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:03.430168 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:03.616607 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7b783721-5ea8-4399-b5a9-b6a8da9fcb34 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:03.624893 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7b783721-5ea8-4399-b5a9-b6a8da9fcb34 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.225950 Aug 22 12:48:03.639799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 96/194] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:03 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:04.647543 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2d963c93-66f1-4cbe-b3fd-718d20695f15 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:04.648158 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2d963c93-66f1-4cbe-b3fd-718d20695f15 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:04.654785 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d963c93-66f1-4cbe-b3fd-718d20695f15 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:04.655274 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d963c93-66f1-4cbe-b3fd-718d20695f15 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:04.655867 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d963c93-66f1-4cbe-b3fd-718d20695f15 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:04.656584 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d963c93-66f1-4cbe-b3fd-718d20695f15 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:04.657056 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d963c93-66f1-4cbe-b3fd-718d20695f15 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:04.657715 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d963c93-66f1-4cbe-b3fd-718d20695f15 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:04.815637 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2d963c93-66f1-4cbe-b3fd-718d20695f15 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:04.820333 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2d963c93-66f1-4cbe-b3fd-718d20695f15 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.177221 Aug 22 12:48:04.820898 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 99/195] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:04 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:05.841672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4896a363-158e-4116-8958-340a32c051cd tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:05.842370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4896a363-158e-4116-8958-340a32c051cd tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:05.851814 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4896a363-158e-4116-8958-340a32c051cd tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:05.852674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4896a363-158e-4116-8958-340a32c051cd tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:05.853113 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4896a363-158e-4116-8958-340a32c051cd tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:05.854687 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4896a363-158e-4116-8958-340a32c051cd tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:05.855164 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4896a363-158e-4116-8958-340a32c051cd tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:05.856273 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4896a363-158e-4116-8958-340a32c051cd tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:05.996083 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-4896a363-158e-4116-8958-340a32c051cd tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:06.003935 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4896a363-158e-4116-8958-340a32c051cd tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.166636 Aug 22 12:48:06.004421 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 97/196] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:05 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:07.036787 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a4050203-fce8-4def-b5fc-34867da42405 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:07.037430 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a4050203-fce8-4def-b5fc-34867da42405 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:07.043582 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4050203-fce8-4def-b5fc-34867da42405 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:07.044005 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4050203-fce8-4def-b5fc-34867da42405 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:07.044441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4050203-fce8-4def-b5fc-34867da42405 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:07.045135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4050203-fce8-4def-b5fc-34867da42405 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:07.045587 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4050203-fce8-4def-b5fc-34867da42405 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:07.046010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4050203-fce8-4def-b5fc-34867da42405 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:07.209285 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a4050203-fce8-4def-b5fc-34867da42405 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:07.219645 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a4050203-fce8-4def-b5fc-34867da42405 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.186647 Aug 22 12:48:07.220420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 100/197] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:07 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:08.246112 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a5dce103-4f5b-4cca-be69-4a071f44aa86 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:08.246661 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a5dce103-4f5b-4cca-be69-4a071f44aa86 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:08.253543 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a5dce103-4f5b-4cca-be69-4a071f44aa86 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:08.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a5dce103-4f5b-4cca-be69-4a071f44aa86 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:08.254501 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a5dce103-4f5b-4cca-be69-4a071f44aa86 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:08.255190 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a5dce103-4f5b-4cca-be69-4a071f44aa86 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:08.255644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a5dce103-4f5b-4cca-be69-4a071f44aa86 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:08.256070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a5dce103-4f5b-4cca-be69-4a071f44aa86 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:08.393954 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a5dce103-4f5b-4cca-be69-4a071f44aa86 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:08.401714 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a5dce103-4f5b-4cca-be69-4a071f44aa86 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.159426 Aug 22 12:48:08.402498 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 98/198] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:08 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:09.421600 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c1906f00-e168-4d01-a94a-bffa370c5f74 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:09.426686 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c1906f00-e168-4d01-a94a-bffa370c5f74 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:09.428511 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1906f00-e168-4d01-a94a-bffa370c5f74 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:09.429002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1906f00-e168-4d01-a94a-bffa370c5f74 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:09.429436 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1906f00-e168-4d01-a94a-bffa370c5f74 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:09.430130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1906f00-e168-4d01-a94a-bffa370c5f74 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:09.430612 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1906f00-e168-4d01-a94a-bffa370c5f74 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:09.431031 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1906f00-e168-4d01-a94a-bffa370c5f74 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:09.572369 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c1906f00-e168-4d01-a94a-bffa370c5f74 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:09.583307 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c1906f00-e168-4d01-a94a-bffa370c5f74 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.163107 Aug 22 12:48:09.583307 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 101/199] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:09 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:10.601061 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-db0d63f5-e73a-4ec7-b534-ca2e65b9b2ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:10.601672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-db0d63f5-e73a-4ec7-b534-ca2e65b9b2ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:10.608978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db0d63f5-e73a-4ec7-b534-ca2e65b9b2ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:10.609470 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db0d63f5-e73a-4ec7-b534-ca2e65b9b2ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:10.610233 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db0d63f5-e73a-4ec7-b534-ca2e65b9b2ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:10.610933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db0d63f5-e73a-4ec7-b534-ca2e65b9b2ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:10.611397 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db0d63f5-e73a-4ec7-b534-ca2e65b9b2ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:10.611831 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db0d63f5-e73a-4ec7-b534-ca2e65b9b2ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:10.747819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-db0d63f5-e73a-4ec7-b534-ca2e65b9b2ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:10.755416 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-db0d63f5-e73a-4ec7-b534-ca2e65b9b2ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.158281 Aug 22 12:48:10.755978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 99/200] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:10 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:11.776254 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-da22458d-fb43-4d37-adb6-6f0b81e544d7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:11.776875 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-da22458d-fb43-4d37-adb6-6f0b81e544d7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:11.782995 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da22458d-fb43-4d37-adb6-6f0b81e544d7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:11.783477 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da22458d-fb43-4d37-adb6-6f0b81e544d7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:11.783907 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da22458d-fb43-4d37-adb6-6f0b81e544d7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:11.784590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da22458d-fb43-4d37-adb6-6f0b81e544d7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:11.785062 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da22458d-fb43-4d37-adb6-6f0b81e544d7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:11.785483 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da22458d-fb43-4d37-adb6-6f0b81e544d7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:11.916283 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-da22458d-fb43-4d37-adb6-6f0b81e544d7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:11.925213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-da22458d-fb43-4d37-adb6-6f0b81e544d7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.153409 Aug 22 12:48:11.937574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 102/201] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:11 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:12.459274 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ea192145-2e19-4a69-b4a0-9ae45ead80c7 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:12.459274 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ea192145-2e19-4a69-b4a0-9ae45ead80c7 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:12.463055 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea192145-2e19-4a69-b4a0-9ae45ead80c7 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:12.463731 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea192145-2e19-4a69-b4a0-9ae45ead80c7 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:12.464311 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea192145-2e19-4a69-b4a0-9ae45ead80c7 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:12.465156 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea192145-2e19-4a69-b4a0-9ae45ead80c7 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:12.466448 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea192145-2e19-4a69-b4a0-9ae45ead80c7 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:12.467020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea192145-2e19-4a69-b4a0-9ae45ead80c7 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:12.501165 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ea192145-2e19-4a69-b4a0-9ae45ead80c7 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Going to try to terminate instance {{(pid=127810) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:48:12.813832 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ea192145-2e19-4a69-b4a0-9ae45ead80c7 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 204 len: 0 microversion: 2.1 time: 0.361897 Aug 22 12:48:12.815749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 100/202] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:48:12 2022] DELETE /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:48:12.826352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-07c09154-18e8-432d-a492-e08d6240effb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:12.827523 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-07c09154-18e8-432d-a492-e08d6240effb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:12.835727 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07c09154-18e8-432d-a492-e08d6240effb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:12.836372 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07c09154-18e8-432d-a492-e08d6240effb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:12.836958 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07c09154-18e8-432d-a492-e08d6240effb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:12.838104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07c09154-18e8-432d-a492-e08d6240effb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:12.838595 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07c09154-18e8-432d-a492-e08d6240effb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:12.839205 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07c09154-18e8-432d-a492-e08d6240effb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:12.947891 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1afbae61-a7a7-4547-a58e-df903d7dc756 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:12.948845 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1afbae61-a7a7-4547-a58e-df903d7dc756 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:12.960897 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1afbae61-a7a7-4547-a58e-df903d7dc756 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:12.960897 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1afbae61-a7a7-4547-a58e-df903d7dc756 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:12.960897 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1afbae61-a7a7-4547-a58e-df903d7dc756 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:12.960897 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1afbae61-a7a7-4547-a58e-df903d7dc756 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:12.961308 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1afbae61-a7a7-4547-a58e-df903d7dc756 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:12.961308 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1afbae61-a7a7-4547-a58e-df903d7dc756 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:13.019338 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-07c09154-18e8-432d-a492-e08d6240effb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:13.031927 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-07c09154-18e8-432d-a492-e08d6240effb tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1554 microversion: 2.1 time: 0.211373 Aug 22 12:48:13.032816 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 103/203] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:12 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:13.121608 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1afbae61-a7a7-4547-a58e-df903d7dc756 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:13.127900 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1afbae61-a7a7-4547-a58e-df903d7dc756 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.184218 Aug 22 12:48:13.128486 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 101/204] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:12 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:14.053663 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-cad2a3dc-51e8-4bcc-a654-87aa30620e04 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:14.054372 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-cad2a3dc-51e8-4bcc-a654-87aa30620e04 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:14.065120 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cad2a3dc-51e8-4bcc-a654-87aa30620e04 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:14.069213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cad2a3dc-51e8-4bcc-a654-87aa30620e04 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:14.069213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cad2a3dc-51e8-4bcc-a654-87aa30620e04 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:14.069213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cad2a3dc-51e8-4bcc-a654-87aa30620e04 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:14.069213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cad2a3dc-51e8-4bcc-a654-87aa30620e04 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:14.069765 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cad2a3dc-51e8-4bcc-a654-87aa30620e04 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:14.149361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-aab599c4-7878-41fb-9b3f-b6373c10f755 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:14.149983 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-aab599c4-7878-41fb-9b3f-b6373c10f755 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:14.156512 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aab599c4-7878-41fb-9b3f-b6373c10f755 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:14.157026 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aab599c4-7878-41fb-9b3f-b6373c10f755 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:14.157468 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aab599c4-7878-41fb-9b3f-b6373c10f755 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:14.158329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aab599c4-7878-41fb-9b3f-b6373c10f755 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:14.158794 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aab599c4-7878-41fb-9b3f-b6373c10f755 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:14.159220 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aab599c4-7878-41fb-9b3f-b6373c10f755 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:14.301350 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-cad2a3dc-51e8-4bcc-a654-87aa30620e04 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:14.313317 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-cad2a3dc-51e8-4bcc-a654-87aa30620e04 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1554 microversion: 2.1 time: 0.264149 Aug 22 12:48:14.313900 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 104/205] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:14 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1554 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:14.349880 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-aab599c4-7878-41fb-9b3f-b6373c10f755 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:14.359376 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-aab599c4-7878-41fb-9b3f-b6373c10f755 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.213755 Aug 22 12:48:14.360173 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 102/206] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:14 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:15.336064 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b44aabcb-60f9-445f-a2c0-689220fc02ae tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:15.337690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b44aabcb-60f9-445f-a2c0-689220fc02ae tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:15.352114 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b44aabcb-60f9-445f-a2c0-689220fc02ae tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:15.352618 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b44aabcb-60f9-445f-a2c0-689220fc02ae tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:15.353055 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b44aabcb-60f9-445f-a2c0-689220fc02ae tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:15.354018 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b44aabcb-60f9-445f-a2c0-689220fc02ae tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:15.354501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b44aabcb-60f9-445f-a2c0-689220fc02ae tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:15.354930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b44aabcb-60f9-445f-a2c0-689220fc02ae tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:15.383617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2c682e6f-fc7f-43e0-afb4-5c45c5a54788 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:15.384761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2c682e6f-fc7f-43e0-afb4-5c45c5a54788 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:15.395266 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2c682e6f-fc7f-43e0-afb4-5c45c5a54788 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:15.408230 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2c682e6f-fc7f-43e0-afb4-5c45c5a54788 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:15.408846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2c682e6f-fc7f-43e0-afb4-5c45c5a54788 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:15.409624 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2c682e6f-fc7f-43e0-afb4-5c45c5a54788 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:15.410093 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2c682e6f-fc7f-43e0-afb4-5c45c5a54788 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:15.410545 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2c682e6f-fc7f-43e0-afb4-5c45c5a54788 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:15.648859 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b44aabcb-60f9-445f-a2c0-689220fc02ae tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:15.650708 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2c682e6f-fc7f-43e0-afb4-5c45c5a54788 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:15.662701 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2c682e6f-fc7f-43e0-afb4-5c45c5a54788 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.282651 Aug 22 12:48:15.663397 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 103/207] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:15 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:15.663554 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b44aabcb-60f9-445f-a2c0-689220fc02ae tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1554 microversion: 2.1 time: 0.333357 Aug 22 12:48:15.666215 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 105/208] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:15 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1554 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:16.332464 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-fc278ff1-010d-4b70-9125-10325d087c95 req-82f77b1d-633d-4457-bbe1-b25c0d2dff23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c28a24f-c2f3-412a-9d9b-b152e4407042", "name": "network-vif-deleted", "tag": "0be03a40-3f02-4195-8045-9ce908e5f55e"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:16.344970 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-fc278ff1-010d-4b70-9125-10325d087c95 req-82f77b1d-633d-4457-bbe1-b25c0d2dff23 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:16.345453 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-fc278ff1-010d-4b70-9125-10325d087c95 req-82f77b1d-633d-4457-bbe1-b25c0d2dff23 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:16.345880 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-fc278ff1-010d-4b70-9125-10325d087c95 req-82f77b1d-633d-4457-bbe1-b25c0d2dff23 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:16.358536 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-fc278ff1-010d-4b70-9125-10325d087c95 req-82f77b1d-633d-4457-bbe1-b25c0d2dff23 service nova] Creating event network-vif-deleted:0be03a40-3f02-4195-8045-9ce908e5f55e for instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 on hv-cinder-85083 Aug 22 12:48:16.363908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-fc278ff1-010d-4b70-9125-10325d087c95 req-82f77b1d-633d-4457-bbe1-b25c0d2dff23 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034952 Aug 22 12:48:16.365569 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 104/209] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:48:16.683812 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-323a7ab3-f419-4c49-830b-dd724de8a03f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:16.684958 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-323a7ab3-f419-4c49-830b-dd724de8a03f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:16.686016 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b0d822bd-4617-46f9-985f-bd970bb373a4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:16.686784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b0d822bd-4617-46f9-985f-bd970bb373a4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:16.691515 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-323a7ab3-f419-4c49-830b-dd724de8a03f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:16.692012 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-323a7ab3-f419-4c49-830b-dd724de8a03f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:16.692433 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-323a7ab3-f419-4c49-830b-dd724de8a03f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:16.692777 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0d822bd-4617-46f9-985f-bd970bb373a4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:16.693129 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-323a7ab3-f419-4c49-830b-dd724de8a03f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:16.693254 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0d822bd-4617-46f9-985f-bd970bb373a4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:16.693587 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-323a7ab3-f419-4c49-830b-dd724de8a03f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:16.693713 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0d822bd-4617-46f9-985f-bd970bb373a4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:16.694008 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-323a7ab3-f419-4c49-830b-dd724de8a03f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:16.694417 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0d822bd-4617-46f9-985f-bd970bb373a4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:16.694867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0d822bd-4617-46f9-985f-bd970bb373a4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:16.695281 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0d822bd-4617-46f9-985f-bd970bb373a4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:16.765744 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-323a7ab3-f419-4c49-830b-dd724de8a03f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:16.774014 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-323a7ab3-f419-4c49-830b-dd724de8a03f tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1512 microversion: 2.1 time: 0.093990 Aug 22 12:48:16.774619 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 106/210] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:16 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:16.890458 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b0d822bd-4617-46f9-985f-bd970bb373a4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:16.901421 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b0d822bd-4617-46f9-985f-bd970bb373a4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.220367 Aug 22 12:48:16.902324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 105/211] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:16 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:17.795520 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-baf35053-9d83-4a5f-b52f-d2e4c57450ac tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:17.796166 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-baf35053-9d83-4a5f-b52f-d2e4c57450ac tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:17.802749 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-baf35053-9d83-4a5f-b52f-d2e4c57450ac tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:17.803273 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-baf35053-9d83-4a5f-b52f-d2e4c57450ac tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:17.803734 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-baf35053-9d83-4a5f-b52f-d2e4c57450ac tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:17.804426 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-baf35053-9d83-4a5f-b52f-d2e4c57450ac tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:17.804886 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-baf35053-9d83-4a5f-b52f-d2e4c57450ac tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:17.805311 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-baf35053-9d83-4a5f-b52f-d2e4c57450ac tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:17.869699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-baf35053-9d83-4a5f-b52f-d2e4c57450ac tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:17.878151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-baf35053-9d83-4a5f-b52f-d2e4c57450ac tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1512 microversion: 2.1 time: 0.087084 Aug 22 12:48:17.879037 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 107/212] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:17 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1512 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:17.923259 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ed69f4db-6cd7-453e-a892-ef6b3816a4b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:17.923874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ed69f4db-6cd7-453e-a892-ef6b3816a4b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:17.930419 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed69f4db-6cd7-453e-a892-ef6b3816a4b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:17.930908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed69f4db-6cd7-453e-a892-ef6b3816a4b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:17.931345 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed69f4db-6cd7-453e-a892-ef6b3816a4b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:17.932041 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed69f4db-6cd7-453e-a892-ef6b3816a4b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:17.932499 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed69f4db-6cd7-453e-a892-ef6b3816a4b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:17.932936 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ed69f4db-6cd7-453e-a892-ef6b3816a4b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:18.075227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ed69f4db-6cd7-453e-a892-ef6b3816a4b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:18.084963 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ed69f4db-6cd7-453e-a892-ef6b3816a4b0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.164372 Aug 22 12:48:18.085762 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 106/213] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:17 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:18.900145 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a0793b33-1e64-4e05-9274-85195c678e74 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:18.900805 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a0793b33-1e64-4e05-9274-85195c678e74 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:18.906760 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a0793b33-1e64-4e05-9274-85195c678e74 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:18.907248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a0793b33-1e64-4e05-9274-85195c678e74 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:18.907684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a0793b33-1e64-4e05-9274-85195c678e74 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:18.908379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a0793b33-1e64-4e05-9274-85195c678e74 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:18.908834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a0793b33-1e64-4e05-9274-85195c678e74 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:18.909263 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a0793b33-1e64-4e05-9274-85195c678e74 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:18.972043 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a0793b33-1e64-4e05-9274-85195c678e74 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:18.981527 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a0793b33-1e64-4e05-9274-85195c678e74 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1346 microversion: 2.1 time: 0.085570 Aug 22 12:48:18.982098 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 108/214] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:18 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:19.108155 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b6b54dbf-c8d8-403c-aeb3-57c2318d296c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:19.108763 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b6b54dbf-c8d8-403c-aeb3-57c2318d296c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:19.115219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6b54dbf-c8d8-403c-aeb3-57c2318d296c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:19.115702 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6b54dbf-c8d8-403c-aeb3-57c2318d296c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:19.116139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6b54dbf-c8d8-403c-aeb3-57c2318d296c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:19.116826 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6b54dbf-c8d8-403c-aeb3-57c2318d296c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:19.117283 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6b54dbf-c8d8-403c-aeb3-57c2318d296c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:19.117715 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6b54dbf-c8d8-403c-aeb3-57c2318d296c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:19.242154 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b6b54dbf-c8d8-403c-aeb3-57c2318d296c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:19.250651 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b6b54dbf-c8d8-403c-aeb3-57c2318d296c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.147233 Aug 22 12:48:19.251219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 107/215] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:19 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:19.695492 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-88948133", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:19.755224 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] validate_networks() for None {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:48:20.003437 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:20.003955 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:20.010599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:20.011087 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:20.011517 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:20.012470 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:20.013978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:20.020094 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:20.049562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:20.050049 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:20.050600 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:20.051123 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lazy-loading 'fault' on Instance uuid 3c28a24f-c2f3-412a-9d9b-b152e4407042 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:48:20.146621 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56a8835b7a764c65820758eaf7accbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5574355e5db64af7bf6a0469c29f5569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:20.152642 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-cd52e93f-5855-4473-9ffd-f1001f9c0136 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 200 len: 1351 microversion: 2.1 time: 0.152997 Aug 22 12:48:20.153799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 108/216] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:19 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 1351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:20.229093 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:48:20.229567 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:48:20.229974 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:48:20.230678 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:48:20.231651 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:48:20.240673 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:20.241148 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:20.241579 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:20.242355 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:20.242814 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:20.243303 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:20.261336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Getting quotas for project 8669fceab64144828ca5aab86b8f39b6. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:48:20.265583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Getting quotas for user ed492b61eb0e44c8b5ab7caf5cd2507c and project 8669fceab64144828ca5aab86b8f39b6. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:48:20.278894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:48:20.279545 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b324256f-986f-42c8-bec8-7ee1359dc548 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:20.280162 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b324256f-986f-42c8-bec8-7ee1359dc548 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:20.281571 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:48:20.292026 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b324256f-986f-42c8-bec8-7ee1359dc548 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:20.292535 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b324256f-986f-42c8-bec8-7ee1359dc548 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:20.292976 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b324256f-986f-42c8-bec8-7ee1359dc548 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:20.294271 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b324256f-986f-42c8-bec8-7ee1359dc548 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:20.294748 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b324256f-986f-42c8-bec8-7ee1359dc548 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:20.295180 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b324256f-986f-42c8-bec8-7ee1359dc548 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:20.411114 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ea6f4e90-19d8-4309-a1fb-4e746c4804fc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719381 Aug 22 12:48:20.411830 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 109/217] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:48:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:48:20.423253 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-16ffce79-e18f-42e3-b683-3ca2a40d8a0e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:20.424082 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-16ffce79-e18f-42e3-b683-3ca2a40d8a0e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:20.445328 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b324256f-986f-42c8-bec8-7ee1359dc548 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:20.458396 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b324256f-986f-42c8-bec8-7ee1359dc548 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.184260 Aug 22 12:48:20.458396 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 109/218] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:20 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:20.500498 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-16ffce79-e18f-42e3-b683-3ca2a40d8a0e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:20.510628 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-16ffce79-e18f-42e3-b683-3ca2a40d8a0e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1213 microversion: 2.1 time: 0.091110 Aug 22 12:48:20.511509 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 110/219] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:20 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:21.174564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:21.175256 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:21.181863 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:21.182502 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:21.182815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:21.183508 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:21.184004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:21.185116 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:21.202725 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] HTTP exception thrown: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Request method failure captured: Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 HTTP/1.1 Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rI4TwpT3ARBPqoMiJOoWvZkO76g2WY0uV91fX0_x-nwqIVeZdFiaJeCIc8Ror1zY8MvMeIyvUG4CEprS6mi8SNRSH2_RadfmiRhfSIlh5XwhD8rj4dVyShh95wQciox51WnwP4wQe-7IQHLW0CRYqBB8gHfz96E9xfyUmDyaraa8g Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 5574355e5db64af7bf6a0469c29f5569 Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:48:21.207211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5574355e5db64af7bf6a0469c29f5569"}]}] Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 5574355e5db64af7bf6a0469c29f5569 Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-DeleteServersTestJSON-597899492-project Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 56a8835b7a764c65820758eaf7accbbe Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-DeleteServersTestJSON-597899492-project Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:21.208537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '3c28a24f-c2f3-412a-9d9b-b152e4407042'} Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:21.209213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:21.210367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:21.211319 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Returning 404 to user: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:21.211319 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a660529f-9fb1-4064-8a9c-55c8153e5ef2 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 404 len: 111 microversion: 2.1 time: 0.038400 Aug 22 12:48:21.211319 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 110/220] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:21 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:48:21.363632 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:21.372579 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:21.378579 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:21.379083 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:21.379521 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:21.380227 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:21.380685 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:21.381232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:21.395192 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] HTTP exception thrown: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Request method failure captured: Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042/os-volume_attachments HTTP/1.1 Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3rI4TwpT3ARBPqoMiJOoWvZkO76g2WY0uV91fX0_x-nwqIVeZdFiaJeCIc8Ror1zY8MvMeIyvUG4CEprS6mi8SNRSH2_RadfmiRhfSIlh5XwhD8rj4dVyShh95wQciox51WnwP4wQe-7IQHLW0CRYqBB8gHfz96E9xfyUmDyaraa8g Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 5574355e5db64af7bf6a0469c29f5569 Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:48:21.405133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5574355e5db64af7bf6a0469c29f5569"}]}] Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 5574355e5db64af7bf6a0469c29f5569 Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-DeleteServersTestJSON-597899492-project Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 56a8835b7a764c65820758eaf7accbbe Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-DeleteServersTestJSON-597899492-project Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:21.406530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'server_id': '3c28a24f-c2f3-412a-9d9b-b152e4407042'} Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:21.407929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:21.409246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:21.410849 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Returning 404 to user: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:21.410849 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f40cef6b-e922-4602-bd65-b09fbc8ecdd0 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047806 Aug 22 12:48:21.410849 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 111/221] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:48:21 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:48:21.484150 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6d396df0-e551-4e91-886f-1742b3d27b93 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:21.486513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6d396df0-e551-4e91-886f-1742b3d27b93 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:21.506618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6d396df0-e551-4e91-886f-1742b3d27b93 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:21.507122 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6d396df0-e551-4e91-886f-1742b3d27b93 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:21.507566 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6d396df0-e551-4e91-886f-1742b3d27b93 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:21.508277 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6d396df0-e551-4e91-886f-1742b3d27b93 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:21.508732 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6d396df0-e551-4e91-886f-1742b3d27b93 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:21.513370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6d396df0-e551-4e91-886f-1742b3d27b93 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:21.536289 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5effcad8-267e-4897-b3b8-8968e169e935 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:21.537340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-5effcad8-267e-4897-b3b8-8968e169e935 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:21.616688 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-5effcad8-267e-4897-b3b8-8968e169e935 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:21.623815 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-5effcad8-267e-4897-b3b8-8968e169e935 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1213 microversion: 2.1 time: 0.094423 Aug 22 12:48:21.624531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 112/222] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:21 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:21.677504 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6d396df0-e551-4e91-886f-1742b3d27b93 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:21.685790 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6d396df0-e551-4e91-886f-1742b3d27b93 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.207267 Aug 22 12:48:21.686582 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 111/223] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:21 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:22.645536 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bf4a1b47-b9e1-46cf-a2af-6aa158ff7d42 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:22.646277 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bf4a1b47-b9e1-46cf-a2af-6aa158ff7d42 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:22.648456 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:22.654130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bf4a1b47-b9e1-46cf-a2af-6aa158ff7d42 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:22.654638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bf4a1b47-b9e1-46cf-a2af-6aa158ff7d42 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:22.655069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bf4a1b47-b9e1-46cf-a2af-6aa158ff7d42 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:22.656095 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bf4a1b47-b9e1-46cf-a2af-6aa158ff7d42 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:22.656543 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bf4a1b47-b9e1-46cf-a2af-6aa158ff7d42 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:22.656968 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bf4a1b47-b9e1-46cf-a2af-6aa158ff7d42 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:22.707760 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-71eaaf4d-570d-4737-a897-d3d7dfea0660 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:22.708369 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-71eaaf4d-570d-4737-a897-d3d7dfea0660 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:22.724837 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71eaaf4d-570d-4737-a897-d3d7dfea0660 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:22.725346 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71eaaf4d-570d-4737-a897-d3d7dfea0660 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:22.725780 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71eaaf4d-570d-4737-a897-d3d7dfea0660 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:22.726514 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71eaaf4d-570d-4737-a897-d3d7dfea0660 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:22.726970 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71eaaf4d-570d-4737-a897-d3d7dfea0660 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:22.727388 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71eaaf4d-570d-4737-a897-d3d7dfea0660 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:22.735454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bf4a1b47-b9e1-46cf-a2af-6aa158ff7d42 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:22.738800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:22.744512 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bf4a1b47-b9e1-46cf-a2af-6aa158ff7d42 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1209 microversion: 2.1 time: 0.103133 Aug 22 12:48:22.745272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 113/224] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:22 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:22.884585 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-71eaaf4d-570d-4737-a897-d3d7dfea0660 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:22.893667 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-71eaaf4d-570d-4737-a897-d3d7dfea0660 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.189828 Aug 22 12:48:22.894386 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 112/225] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:22 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:23.161324 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:23.161820 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:23.167938 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:23.168424 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:23.168860 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:23.169556 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:23.170011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:23.170600 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:23.185059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] HTTP exception thrown: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Request method failure captured: Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: DELETE /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 HTTP/1.1 Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3rI4TwpT3ARBPqoMiJOoWvZkO76g2WY0uV91fX0_x-nwqIVeZdFiaJeCIc8Ror1zY8MvMeIyvUG4CEprS6mi8SNRSH2_RadfmiRhfSIlh5XwhD8rj4dVyShh95wQciox51WnwP4wQe-7IQHLW0CRYqBB8gHfz96E9xfyUmDyaraa8g Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 5574355e5db64af7bf6a0469c29f5569 Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:48:23.187946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5574355e5db64af7bf6a0469c29f5569"}]}] Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 5574355e5db64af7bf6a0469c29f5569 Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-DeleteServersTestJSON-597899492-project Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 56a8835b7a764c65820758eaf7accbbe Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-DeleteServersTestJSON-597899492-project Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:23.189318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '3c28a24f-c2f3-412a-9d9b-b152e4407042'} Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:23.190159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:23.191240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:23.194266 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Returning 404 to user: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:23.194266 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-81db2c5d-439c-4a09-a563-5b9d3d4b71dd tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 404 len: 111 microversion: 2.1 time: 0.033884 Aug 22 12:48:23.194266 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 114/226] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:48:23 2022] DELETE /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:48:23.200310 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:23.200912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] [instance: 3c28a24f-c2f3-412a-9d9b-b152e4407042] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:23.208394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:23.208883 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:23.209866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:23.209985 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:23.210466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:23.210886 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:23.224771 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] HTTP exception thrown: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Request method failure captured: Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 HTTP/1.1 Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rI4TwpT3ARBPqoMiJOoWvZkO76g2WY0uV91fX0_x-nwqIVeZdFiaJeCIc8Ror1zY8MvMeIyvUG4CEprS6mi8SNRSH2_RadfmiRhfSIlh5XwhD8rj4dVyShh95wQciox51WnwP4wQe-7IQHLW0CRYqBB8gHfz96E9xfyUmDyaraa8g Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 5574355e5db64af7bf6a0469c29f5569 Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:48:23.226329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5574355e5db64af7bf6a0469c29f5569"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5574355e5db64af7bf6a0469c29f5569"}]}] Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 5574355e5db64af7bf6a0469c29f5569 Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-DeleteServersTestJSON-597899492 Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-DeleteServersTestJSON-597899492-project Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 56a8835b7a764c65820758eaf7accbbe Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-DeleteServersTestJSON-597899492-project Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:23.227825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '3c28a24f-c2f3-412a-9d9b-b152e4407042'} Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:23.232227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. Aug 22 12:48:23.233425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:23.234648 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] Returning 404 to user: Instance 3c28a24f-c2f3-412a-9d9b-b152e4407042 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:23.234648 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0e0ae4a9-9201-470f-9cf5-b3096f74d109 tempest-DeleteServersTestJSON-597899492 tempest-DeleteServersTestJSON-597899492-project] 10.222.0.15 "GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042" status: 404 len: 111 microversion: 2.1 time: 0.031772 Aug 22 12:48:23.234648 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 113/227] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:23 2022] GET /compute/v2.1/servers/3c28a24f-c2f3-412a-9d9b-b152e4407042 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:48:23.765047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-44d630de-e364-4d82-8b8c-f4d2aacb9b53 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:23.766250 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-44d630de-e364-4d82-8b8c-f4d2aacb9b53 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:23.772896 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-44d630de-e364-4d82-8b8c-f4d2aacb9b53 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:23.773660 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-44d630de-e364-4d82-8b8c-f4d2aacb9b53 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:23.774362 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-44d630de-e364-4d82-8b8c-f4d2aacb9b53 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:23.778745 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-44d630de-e364-4d82-8b8c-f4d2aacb9b53 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:23.779553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-44d630de-e364-4d82-8b8c-f4d2aacb9b53 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:23.782118 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-44d630de-e364-4d82-8b8c-f4d2aacb9b53 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:23.857098 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-44d630de-e364-4d82-8b8c-f4d2aacb9b53 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:23.861347 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=100 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:23.866108 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-44d630de-e364-4d82-8b8c-f4d2aacb9b53 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1273 microversion: 2.1 time: 0.105194 Aug 22 12:48:23.867171 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 115/228] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:23 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:23.916085 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-303dbb29-5dc9-4f59-b924-0fcedb0d4fa4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:23.916993 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-303dbb29-5dc9-4f59-b924-0fcedb0d4fa4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:23.925313 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-303dbb29-5dc9-4f59-b924-0fcedb0d4fa4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:23.926042 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-303dbb29-5dc9-4f59-b924-0fcedb0d4fa4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:23.926775 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-303dbb29-5dc9-4f59-b924-0fcedb0d4fa4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:23.927903 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-303dbb29-5dc9-4f59-b924-0fcedb0d4fa4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:23.928573 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-303dbb29-5dc9-4f59-b924-0fcedb0d4fa4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:23.929440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-303dbb29-5dc9-4f59-b924-0fcedb0d4fa4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:24.082749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-303dbb29-5dc9-4f59-b924-0fcedb0d4fa4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:24.090526 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-303dbb29-5dc9-4f59-b924-0fcedb0d4fa4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.179338 Aug 22 12:48:24.091084 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 114/229] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:23 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:24.891040 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1d2876c3-a06d-411e-b441-bbd001b3f233 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:24.892282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1d2876c3-a06d-411e-b441-bbd001b3f233 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:24.898539 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d2876c3-a06d-411e-b441-bbd001b3f233 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:24.899020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d2876c3-a06d-411e-b441-bbd001b3f233 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:24.911361 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d2876c3-a06d-411e-b441-bbd001b3f233 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:24.912242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d2876c3-a06d-411e-b441-bbd001b3f233 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:24.912723 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d2876c3-a06d-411e-b441-bbd001b3f233 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:24.913164 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d2876c3-a06d-411e-b441-bbd001b3f233 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:24.976426 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1d2876c3-a06d-411e-b441-bbd001b3f233 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:24.990621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1d2876c3-a06d-411e-b441-bbd001b3f233 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1271 microversion: 2.1 time: 0.103997 Aug 22 12:48:24.991267 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 116/230] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:24 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:25.112040 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-76edc7b5-fe9d-4a77-8077-3001a7890204 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:25.112677 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-76edc7b5-fe9d-4a77-8077-3001a7890204 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:25.119450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76edc7b5-fe9d-4a77-8077-3001a7890204 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:25.119931 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76edc7b5-fe9d-4a77-8077-3001a7890204 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:25.120364 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76edc7b5-fe9d-4a77-8077-3001a7890204 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:25.121049 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76edc7b5-fe9d-4a77-8077-3001a7890204 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:25.121497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76edc7b5-fe9d-4a77-8077-3001a7890204 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:25.121937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76edc7b5-fe9d-4a77-8077-3001a7890204 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:25.297256 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-76edc7b5-fe9d-4a77-8077-3001a7890204 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:25.305000 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-76edc7b5-fe9d-4a77-8077-3001a7890204 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.196882 Aug 22 12:48:25.305592 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 115/231] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:25 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:26.013397 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5a5e9922-59c5-4660-bdd0-502221b7a5c0 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:26.014833 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-5a5e9922-59c5-4660-bdd0-502221b7a5c0 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:26.056118 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5a5e9922-59c5-4660-bdd0-502221b7a5c0 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:26.060517 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5a5e9922-59c5-4660-bdd0-502221b7a5c0 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:26.064389 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5a5e9922-59c5-4660-bdd0-502221b7a5c0 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:26.069663 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5a5e9922-59c5-4660-bdd0-502221b7a5c0 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:26.070265 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5a5e9922-59c5-4660-bdd0-502221b7a5c0 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:26.070722 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5a5e9922-59c5-4660-bdd0-502221b7a5c0 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:26.327796 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b62bc076-d13c-498b-a11f-1fc47b4738b2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:26.328509 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b62bc076-d13c-498b-a11f-1fc47b4738b2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:26.335183 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b62bc076-d13c-498b-a11f-1fc47b4738b2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:26.335865 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b62bc076-d13c-498b-a11f-1fc47b4738b2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:26.336618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b62bc076-d13c-498b-a11f-1fc47b4738b2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:26.337471 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b62bc076-d13c-498b-a11f-1fc47b4738b2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:26.338087 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b62bc076-d13c-498b-a11f-1fc47b4738b2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:26.338694 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b62bc076-d13c-498b-a11f-1fc47b4738b2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:26.532767 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-5a5e9922-59c5-4660-bdd0-502221b7a5c0 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:26.544757 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-5a5e9922-59c5-4660-bdd0-502221b7a5c0 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1313 microversion: 2.1 time: 0.536736 Aug 22 12:48:26.545386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 117/232] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:26 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:26.619596 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b62bc076-d13c-498b-a11f-1fc47b4738b2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:26.632982 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b62bc076-d13c-498b-a11f-1fc47b4738b2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.310889 Aug 22 12:48:26.634321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 116/233] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:26 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:26.779761 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-2ae19bf0-4268-4d18-9f09-8fd2b2f4d145 req-7e3da2c8-f737-48b8-8e76-1b7fcc78cffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8815c98-2103-46be-a369-354aabce8da3", "tag": "30f79507-9674-4813-876b-1ebafdfdee63"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:26.803810 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-2ae19bf0-4268-4d18-9f09-8fd2b2f4d145 req-7e3da2c8-f737-48b8-8e76-1b7fcc78cffe service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:26.811635 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-2ae19bf0-4268-4d18-9f09-8fd2b2f4d145 req-7e3da2c8-f737-48b8-8e76-1b7fcc78cffe service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:26.812514 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-2ae19bf0-4268-4d18-9f09-8fd2b2f4d145 req-7e3da2c8-f737-48b8-8e76-1b7fcc78cffe service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:26.841285 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-2ae19bf0-4268-4d18-9f09-8fd2b2f4d145 req-7e3da2c8-f737-48b8-8e76-1b7fcc78cffe service nova] Creating event network-changed:30f79507-9674-4813-876b-1ebafdfdee63 for instance d8815c98-2103-46be-a369-354aabce8da3 on hv-cinder-85083 Aug 22 12:48:26.856412 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-2ae19bf0-4268-4d18-9f09-8fd2b2f4d145 req-7e3da2c8-f737-48b8-8e76-1b7fcc78cffe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083071 Aug 22 12:48:26.857008 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 118/234] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:48:27.576725 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c2b99e1e-0103-4a69-a2e9-dc42be5328d7 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:27.581242 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c2b99e1e-0103-4a69-a2e9-dc42be5328d7 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:27.592816 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c2b99e1e-0103-4a69-a2e9-dc42be5328d7 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:27.596658 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c2b99e1e-0103-4a69-a2e9-dc42be5328d7 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:27.597134 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c2b99e1e-0103-4a69-a2e9-dc42be5328d7 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:27.598982 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c2b99e1e-0103-4a69-a2e9-dc42be5328d7 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:27.599523 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c2b99e1e-0103-4a69-a2e9-dc42be5328d7 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:27.599964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c2b99e1e-0103-4a69-a2e9-dc42be5328d7 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:27.656908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8b75e8f2-6806-4464-bd50-beb16a73df6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:27.658226 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8b75e8f2-6806-4464-bd50-beb16a73df6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:27.665958 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b75e8f2-6806-4464-bd50-beb16a73df6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:27.666726 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b75e8f2-6806-4464-bd50-beb16a73df6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:27.667450 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b75e8f2-6806-4464-bd50-beb16a73df6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:27.668380 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b75e8f2-6806-4464-bd50-beb16a73df6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:27.668984 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b75e8f2-6806-4464-bd50-beb16a73df6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:27.669692 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b75e8f2-6806-4464-bd50-beb16a73df6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:27.914604 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c2b99e1e-0103-4a69-a2e9-dc42be5328d7 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:27.925919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c2b99e1e-0103-4a69-a2e9-dc42be5328d7 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1313 microversion: 2.1 time: 0.354824 Aug 22 12:48:27.935289 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 117/235] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:27 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:28.037306 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8b75e8f2-6806-4464-bd50-beb16a73df6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:28.045859 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8b75e8f2-6806-4464-bd50-beb16a73df6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.394449 Aug 22 12:48:28.046461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 119/236] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:27 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:28.952336 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e1a3ec51-aee6-4b40-90d9-c5b5fda1546d tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:28.952977 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e1a3ec51-aee6-4b40-90d9-c5b5fda1546d tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:28.955372 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:28.960345 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1a3ec51-aee6-4b40-90d9-c5b5fda1546d tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:28.960918 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1a3ec51-aee6-4b40-90d9-c5b5fda1546d tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:28.961362 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1a3ec51-aee6-4b40-90d9-c5b5fda1546d tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:28.962073 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1a3ec51-aee6-4b40-90d9-c5b5fda1546d tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:28.962596 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1a3ec51-aee6-4b40-90d9-c5b5fda1546d tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:28.963026 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1a3ec51-aee6-4b40-90d9-c5b5fda1546d tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:29.066995 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-75cc5fd4-b73b-406e-8f6a-a3cdc9f8e4ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:29.068491 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-75cc5fd4-b73b-406e-8f6a-a3cdc9f8e4ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:29.079398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-75cc5fd4-b73b-406e-8f6a-a3cdc9f8e4ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:29.082820 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-75cc5fd4-b73b-406e-8f6a-a3cdc9f8e4ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:29.082820 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-75cc5fd4-b73b-406e-8f6a-a3cdc9f8e4ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:29.082820 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-75cc5fd4-b73b-406e-8f6a-a3cdc9f8e4ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:29.082820 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-75cc5fd4-b73b-406e-8f6a-a3cdc9f8e4ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:29.083206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-75cc5fd4-b73b-406e-8f6a-a3cdc9f8e4ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:29.150580 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e1a3ec51-aee6-4b40-90d9-c5b5fda1546d tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:29.165490 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e1a3ec51-aee6-4b40-90d9-c5b5fda1546d tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1313 microversion: 2.1 time: 0.221623 Aug 22 12:48:29.166413 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 118/237] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:28 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:29.395602 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-75cc5fd4-b73b-406e-8f6a-a3cdc9f8e4ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:29.403980 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-75cc5fd4-b73b-406e-8f6a-a3cdc9f8e4ef tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1520 microversion: 2.1 time: 0.340756 Aug 22 12:48:29.404548 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 120/238] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:29 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:30.188162 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8f556d47-fa03-4a89-b865-77bb34832e48 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:30.188718 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8f556d47-fa03-4a89-b865-77bb34832e48 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:30.196140 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8f556d47-fa03-4a89-b865-77bb34832e48 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:30.196767 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8f556d47-fa03-4a89-b865-77bb34832e48 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:30.197139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8f556d47-fa03-4a89-b865-77bb34832e48 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:30.197858 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8f556d47-fa03-4a89-b865-77bb34832e48 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:30.198372 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8f556d47-fa03-4a89-b865-77bb34832e48 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:30.198797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8f556d47-fa03-4a89-b865-77bb34832e48 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:30.427309 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-171f94ec-b656-4ca4-8a8f-3df92cb8cc3d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:30.428480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-171f94ec-b656-4ca4-8a8f-3df92cb8cc3d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:30.442599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8f556d47-fa03-4a89-b865-77bb34832e48 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:30.444978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:30.448570 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8f556d47-fa03-4a89-b865-77bb34832e48 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1313 microversion: 2.1 time: 0.265228 Aug 22 12:48:30.449186 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 119/239] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:30 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:30.449771 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-171f94ec-b656-4ca4-8a8f-3df92cb8cc3d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:30.450312 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-171f94ec-b656-4ca4-8a8f-3df92cb8cc3d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:30.450918 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-171f94ec-b656-4ca4-8a8f-3df92cb8cc3d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:30.451664 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-171f94ec-b656-4ca4-8a8f-3df92cb8cc3d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:30.452124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-171f94ec-b656-4ca4-8a8f-3df92cb8cc3d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:30.452561 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-171f94ec-b656-4ca4-8a8f-3df92cb8cc3d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:30.634414 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-171f94ec-b656-4ca4-8a8f-3df92cb8cc3d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:30.647834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-171f94ec-b656-4ca4-8a8f-3df92cb8cc3d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1500 microversion: 2.1 time: 0.224005 Aug 22 12:48:30.662667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 121/240] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:30 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1500 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:30.673157 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-192f66e3-4321-4a87-ba8f-2f3467ba9eab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:30.673766 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-192f66e3-4321-4a87-ba8f-2f3467ba9eab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:30.680323 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-192f66e3-4321-4a87-ba8f-2f3467ba9eab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:30.680814 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-192f66e3-4321-4a87-ba8f-2f3467ba9eab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:30.681247 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-192f66e3-4321-4a87-ba8f-2f3467ba9eab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:30.682094 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-192f66e3-4321-4a87-ba8f-2f3467ba9eab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:30.682767 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-192f66e3-4321-4a87-ba8f-2f3467ba9eab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:30.683627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-192f66e3-4321-4a87-ba8f-2f3467ba9eab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:30.968089 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-192f66e3-4321-4a87-ba8f-2f3467ba9eab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:30.984122 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-192f66e3-4321-4a87-ba8f-2f3467ba9eab tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1516 microversion: 2.1 time: 0.315118 Aug 22 12:48:30.987318 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 120/241] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:30 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1516 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:31.474134 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5fa2dd59-8e63-4282-97a5-7d256d87dbeb tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:31.475538 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-5fa2dd59-8e63-4282-97a5-7d256d87dbeb tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:31.485354 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5fa2dd59-8e63-4282-97a5-7d256d87dbeb tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:31.485962 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5fa2dd59-8e63-4282-97a5-7d256d87dbeb tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:31.486651 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5fa2dd59-8e63-4282-97a5-7d256d87dbeb tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:31.487421 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5fa2dd59-8e63-4282-97a5-7d256d87dbeb tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:31.487987 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5fa2dd59-8e63-4282-97a5-7d256d87dbeb tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:31.488774 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5fa2dd59-8e63-4282-97a5-7d256d87dbeb tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:31.622123 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=10 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:31.672753 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-5fa2dd59-8e63-4282-97a5-7d256d87dbeb tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:31.686126 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-5fa2dd59-8e63-4282-97a5-7d256d87dbeb tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1313 microversion: 2.1 time: 0.218658 Aug 22 12:48:31.686983 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 122/242] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:31 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:32.271424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-08de9365-a082-4212-b854-0d36949f483d tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Action: 'create', calling method: .version_select at 0x7f7659ea60d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1186110783", "metadata": {"Type": "work"}}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-08de9365-a082-4212-b854-0d36949f483d tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Request method failure captured: Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 122 Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3sgXpMnwwNUGNT4dddAI4u9Wull7g2LZ3w-S_b3Tx6nRq-n9jGE4DZUlh4SgAQWw81ELeiJP-V89mhPujyIQDCJ5dWjd41FKF-PZq6zigaPTZPeZJgkgqEwJ6tV_CkXJnec2TdwD7D4Fdoyh74gI8yssh-CNqUPP9L3p01LEPJNosk Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:48:32.283420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f1bfa04c85d400ea13270dbda5c1d86"}]}] Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 872be1e79634406dbe92acc794fadb82 Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1186110783", "metadata": {"Type": "work"}}} Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: Aug 22 12:48:32.284641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1186110783', 'metadata': {'Type': 'work'}}}} Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise error Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi '#$%' Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:32.285375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 12:48:32.286784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 12:48:32.287846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 12:48:32.287846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.287846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-08de9365-a082-4212-b854-0d36949f483d tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:32.287846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-08de9365-a082-4212-b854-0d36949f483d tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.128208 Aug 22 12:48:32.287846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 121/243] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 22 12:48:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 12:48:32.293904 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3f48234a-9c4d-4ea2-8e9a-269f355d1f58 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Action: 'create', calling method: .version_select at 0x7f7659f3baf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2088217201", "metadata": {"Type": "work"}}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3f48234a-9c4d-4ea2-8e9a-269f355d1f58 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Request method failure captured: Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 120 Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3sgXpMnwwNUGNT4dddAI4u9Wull7g2LZ3w-S_b3Tx6nRq-n9jGE4DZUlh4SgAQWw81ELeiJP-V89mhPujyIQDCJ5dWjd41FKF-PZq6zigaPTZPeZJgkgqEwJ6tV_CkXJnec2TdwD7D4Fdoyh74gI8yssh-CNqUPP9L3p01LEPJNosk Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:48:32.299162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f1bfa04c85d400ea13270dbda5c1d86"}]}] Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 872be1e79634406dbe92acc794fadb82 Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2088217201", "metadata": {"Type": "work"}}} Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: Aug 22 12:48:32.300894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2088217201', 'metadata': {'Type': 'work'}}}} Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise error Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi '0' Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:32.302046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 12:48:32.303786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 12:48:32.312010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 12:48:32.312010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.312010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3f48234a-9c4d-4ea2-8e9a-269f355d1f58 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:32.312010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-3f48234a-9c4d-4ea2-8e9a-269f355d1f58 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011959 Aug 22 12:48:32.312010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 123/244] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 22 12:48:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 12:48:32.312556 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f23b2699-53f3-40c3-a194-530b699efb4f tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Action: 'create', calling method: .version_select at 0x7f7659fe8ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-149094454", "metadata": {"Type": "work"}}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f23b2699-53f3-40c3-a194-530b699efb4f tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Request method failure captured: Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 118 Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3sgXpMnwwNUGNT4dddAI4u9Wull7g2LZ3w-S_b3Tx6nRq-n9jGE4DZUlh4SgAQWw81ELeiJP-V89mhPujyIQDCJ5dWjd41FKF-PZq6zigaPTZPeZJgkgqEwJ6tV_CkXJnec2TdwD7D4Fdoyh74gI8yssh-CNqUPP9L3p01LEPJNosk Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:48:32.314964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f1bfa04c85d400ea13270dbda5c1d86"}]}] Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 872be1e79634406dbe92acc794fadb82 Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-149094454", "metadata": {"Type": "work"}}} Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: Aug 22 12:48:32.316433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-149094454', 'metadata': {'Type': 'work'}}}} Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise error Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi '' Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:32.317571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 12:48:32.319321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 12:48:32.320852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 12:48:32.320852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.320852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f23b2699-53f3-40c3-a194-530b699efb4f tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:32.320852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f23b2699-53f3-40c3-a194-530b699efb4f tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010146 Aug 22 12:48:32.320852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 122/245] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 22 12:48:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 22 12:48:32.326622 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dfac1d28-3178-48f5-ac01-70228fc605f6 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Calling method '.version_select at 0x7f7659ee7940>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:32.356804 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-dfac1d28-3178-48f5-ac01-70228fc605f6 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] HTTP exception thrown: Volume tempest-invalid-1318131867 could not be found. Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dfac1d28-3178-48f5-ac01-70228fc605f6 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Request method failure captured: Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1318131867 HTTP/1.1 Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3sgXpMnwwNUGNT4dddAI4u9Wull7g2LZ3w-S_b3Tx6nRq-n9jGE4DZUlh4SgAQWw81ELeiJP-V89mhPujyIQDCJ5dWjd41FKF-PZq6zigaPTZPeZJgkgqEwJ6tV_CkXJnec2TdwD7D4Fdoyh74gI8yssh-CNqUPP9L3p01LEPJNosk Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:48:32.358629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f1bfa04c85d400ea13270dbda5c1d86"}]}] Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 872be1e79634406dbe92acc794fadb82 Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Volume tempest-invalid-1318131867 could not be found. Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': 'tempest-invalid-1318131867'} Aug 22 12:48:32.360124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1318131867 could not be found. (HTTP 404) (Request-ID: req-7f621646-5778-41f3-a3a3-c4b7d577af16) Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.361051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 12:48:32.362802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1318131867 could not be found. Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:48:32.364110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1318131867 could not be found. Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1318131867 could not be found. Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dfac1d28-3178-48f5-ac01-70228fc605f6 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Returning 404 to user: Volume tempest-invalid-1318131867 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-dfac1d28-3178-48f5-ac01-70228fc605f6 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1318131867" status: 404 len: 99 microversion: 2.1 time: 0.037784 Aug 22 12:48:32.365465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 124/246] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Aug 22 12:48:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1318131867 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 12:48:32.369451 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-897cdf5a-bfb9-498e-ba58-2f799d8a9f68 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003723 Aug 22 12:48:32.370163 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 123/247] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Aug 22 12:48:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 12:48:32.378945 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8bedffee-c17b-4cc2-a673-0b0e143f9699 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003775 Aug 22 12:48:32.379448 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 125/248] 10.222.0.15 () {58 vars in 1137 bytes} [Mon Aug 22 12:48:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 12:48:32.398696 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-88ed5c6a-aea5-43fc-86cc-dbfe5e0b24f8 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Calling method '.version_select at 0x7f7659f9df70>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:32.443850 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-88ed5c6a-aea5-43fc-86cc-dbfe5e0b24f8 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] HTTP exception thrown: Volume 0eafeb29-3ce4-413f-a00e-563468f94a81 could not be found. Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-88ed5c6a-aea5-43fc-86cc-dbfe5e0b24f8 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Request method failure captured: Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: DELETE /compute/v2.1/os-volumes/0eafeb29-3ce4-413f-a00e-563468f94a81 HTTP/1.1 Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3sgXpMnwwNUGNT4dddAI4u9Wull7g2LZ3w-S_b3Tx6nRq-n9jGE4DZUlh4SgAQWw81ELeiJP-V89mhPujyIQDCJ5dWjd41FKF-PZq6zigaPTZPeZJgkgqEwJ6tV_CkXJnec2TdwD7D4Fdoyh74gI8yssh-CNqUPP9L3p01LEPJNosk Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:48:32.445820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f1bfa04c85d400ea13270dbda5c1d86"}]}] Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 872be1e79634406dbe92acc794fadb82 Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Volume 0eafeb29-3ce4-413f-a00e-563468f94a81 could not be found. Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '0eafeb29-3ce4-413f-a00e-563468f94a81'} Aug 22 12:48:32.447105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0eafeb29-3ce4-413f-a00e-563468f94a81 could not be found. (HTTP 404) (Request-ID: req-965b842f-f49e-4102-9eb2-4baebff8f8f1) Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.447968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 12:48:32.449091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0eafeb29-3ce4-413f-a00e-563468f94a81 could not be found. Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 12:48:32.451070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0eafeb29-3ce4-413f-a00e-563468f94a81 could not be found. Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0eafeb29-3ce4-413f-a00e-563468f94a81 could not be found. Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-88ed5c6a-aea5-43fc-86cc-dbfe5e0b24f8 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Returning 404 to user: Volume 0eafeb29-3ce4-413f-a00e-563468f94a81 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-88ed5c6a-aea5-43fc-86cc-dbfe5e0b24f8 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/0eafeb29-3ce4-413f-a00e-563468f94a81" status: 404 len: 109 microversion: 2.1 time: 0.052597 Aug 22 12:48:32.458288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 124/249] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 22 12:48:32 2022] DELETE /compute/v2.1/os-volumes/0eafeb29-3ce4-413f-a00e-563468f94a81 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:48:32.459176 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-441f5c9b-750c-42d0-95ed-2dcf482b2ea4 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Calling method '.version_select at 0x7f7659f3b280>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:32.564984 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-441f5c9b-750c-42d0-95ed-2dcf482b2ea4 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] HTTP exception thrown: Volume 14b72fd8-8dc1-46eb-a16c-3ab9a558b88e could not be found. Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-441f5c9b-750c-42d0-95ed-2dcf482b2ea4 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Request method failure captured: Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/os-volumes/14b72fd8-8dc1-46eb-a16c-3ab9a558b88e HTTP/1.1 Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3sgXpMnwwNUGNT4dddAI4u9Wull7g2LZ3w-S_b3Tx6nRq-n9jGE4DZUlh4SgAQWw81ELeiJP-V89mhPujyIQDCJ5dWjd41FKF-PZq6zigaPTZPeZJgkgqEwJ6tV_CkXJnec2TdwD7D4Fdoyh74gI8yssh-CNqUPP9L3p01LEPJNosk Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:48:32.567034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f1bfa04c85d400ea13270dbda5c1d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f1bfa04c85d400ea13270dbda5c1d86"}]}] Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 9f1bfa04c85d400ea13270dbda5c1d86 Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-VolumesNegativeTest-1429979590 Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 872be1e79634406dbe92acc794fadb82 Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-VolumesNegativeTest-1429979590-project Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Volume 14b72fd8-8dc1-46eb-a16c-3ab9a558b88e could not be found. Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '14b72fd8-8dc1-46eb-a16c-3ab9a558b88e'} Aug 22 12:48:32.568371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14b72fd8-8dc1-46eb-a16c-3ab9a558b88e could not be found. (HTTP 404) (Request-ID: req-8e3d4f16-d586-47a9-a456-6e6b818c9751) Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.569339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 12:48:32.570386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14b72fd8-8dc1-46eb-a16c-3ab9a558b88e could not be found. Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 12:48:32.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14b72fd8-8dc1-46eb-a16c-3ab9a558b88e could not be found. Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14b72fd8-8dc1-46eb-a16c-3ab9a558b88e could not be found. Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-441f5c9b-750c-42d0-95ed-2dcf482b2ea4 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] Returning 404 to user: Volume 14b72fd8-8dc1-46eb-a16c-3ab9a558b88e could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-441f5c9b-750c-42d0-95ed-2dcf482b2ea4 tempest-VolumesNegativeTest-1429979590 tempest-VolumesNegativeTest-1429979590-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/14b72fd8-8dc1-46eb-a16c-3ab9a558b88e" status: 404 len: 109 microversion: 2.1 time: 0.114247 Aug 22 12:48:32.572485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 126/250] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 22 12:48:32 2022] GET /compute/v2.1/os-volumes/14b72fd8-8dc1-46eb-a16c-3ab9a558b88e => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:48:32.707464 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-521d4c64-1a87-47bb-926e-df908f54ddfd tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:32.708305 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-521d4c64-1a87-47bb-926e-df908f54ddfd tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:32.714632 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521d4c64-1a87-47bb-926e-df908f54ddfd tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:32.715121 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521d4c64-1a87-47bb-926e-df908f54ddfd tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:32.716056 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521d4c64-1a87-47bb-926e-df908f54ddfd tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:32.716839 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521d4c64-1a87-47bb-926e-df908f54ddfd tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:32.717298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521d4c64-1a87-47bb-926e-df908f54ddfd tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:32.717721 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521d4c64-1a87-47bb-926e-df908f54ddfd tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:32.860016 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-521d4c64-1a87-47bb-926e-df908f54ddfd tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:32.868176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-521d4c64-1a87-47bb-926e-df908f54ddfd tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1313 microversion: 2.1 time: 0.165086 Aug 22 12:48:32.869045 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 125/251] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:32 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:32.937837 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-34bd6303-a1e8-4678-bc16-9b85436abc01 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:32.941214 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-34bd6303-a1e8-4678-bc16-9b85436abc01 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:32.947661 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34bd6303-a1e8-4678-bc16-9b85436abc01 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:32.948247 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34bd6303-a1e8-4678-bc16-9b85436abc01 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:32.948816 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34bd6303-a1e8-4678-bc16-9b85436abc01 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:32.950073 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34bd6303-a1e8-4678-bc16-9b85436abc01 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:32.950555 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34bd6303-a1e8-4678-bc16-9b85436abc01 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:32.950981 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34bd6303-a1e8-4678-bc16-9b85436abc01 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:32.976678 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-34bd6303-a1e8-4678-bc16-9b85436abc01 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lazy-loading 'flavor' on Instance uuid 3fb90990-6e18-45a2-88c4-b725b54a21d6 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:48:33.241899 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-c3c94310-2577-4e8d-a4f4-721e67a98dfb req-81a6fc17-3c39-49b2-8dd7-7ed8d75eb2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8815c98-2103-46be-a369-354aabce8da3", "name": "network-vif-plugged", "status": "completed", "tag": "30f79507-9674-4813-876b-1ebafdfdee63"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:33.254423 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c3c94310-2577-4e8d-a4f4-721e67a98dfb req-81a6fc17-3c39-49b2-8dd7-7ed8d75eb2e5 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:33.256296 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c3c94310-2577-4e8d-a4f4-721e67a98dfb req-81a6fc17-3c39-49b2-8dd7-7ed8d75eb2e5 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:33.257058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c3c94310-2577-4e8d-a4f4-721e67a98dfb req-81a6fc17-3c39-49b2-8dd7-7ed8d75eb2e5 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:33.281067 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-c3c94310-2577-4e8d-a4f4-721e67a98dfb req-81a6fc17-3c39-49b2-8dd7-7ed8d75eb2e5 service nova] Creating event network-vif-plugged:30f79507-9674-4813-876b-1ebafdfdee63 for instance d8815c98-2103-46be-a369-354aabce8da3 on hv-cinder-85083 Aug 22 12:48:33.288833 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-c3c94310-2577-4e8d-a4f4-721e67a98dfb req-81a6fc17-3c39-49b2-8dd7-7ed8d75eb2e5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050404 Aug 22 12:48:33.289553 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 126/252] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:48:33.314721 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-34bd6303-a1e8-4678-bc16-9b85436abc01 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "POST /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6/action" status: 200 len: 32 microversion: 2.1 time: 0.384586 Aug 22 12:48:33.315625 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 127/253] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 12:48:32 2022] POST /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 12:48:33.326120 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-53c8b853-3936-495d-9350-06ed3e8d5f3b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:33.326833 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-53c8b853-3936-495d-9350-06ed3e8d5f3b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:33.333047 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c8b853-3936-495d-9350-06ed3e8d5f3b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:33.333537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c8b853-3936-495d-9350-06ed3e8d5f3b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:33.333979 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c8b853-3936-495d-9350-06ed3e8d5f3b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:33.334702 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c8b853-3936-495d-9350-06ed3e8d5f3b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:33.335425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c8b853-3936-495d-9350-06ed3e8d5f3b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:33.335857 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c8b853-3936-495d-9350-06ed3e8d5f3b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:33.545537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-53c8b853-3936-495d-9350-06ed3e8d5f3b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:33.554498 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-53c8b853-3936-495d-9350-06ed3e8d5f3b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.233202 Aug 22 12:48:33.555802 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 127/254] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:33 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:33.890133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8a866aed-e33e-4ce3-9ebd-7a512b0959e1 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:33.890942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8a866aed-e33e-4ce3-9ebd-7a512b0959e1 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:33.897331 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a866aed-e33e-4ce3-9ebd-7a512b0959e1 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:33.897852 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a866aed-e33e-4ce3-9ebd-7a512b0959e1 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:33.898322 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a866aed-e33e-4ce3-9ebd-7a512b0959e1 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:33.899069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a866aed-e33e-4ce3-9ebd-7a512b0959e1 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:33.899486 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a866aed-e33e-4ce3-9ebd-7a512b0959e1 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:33.899913 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a866aed-e33e-4ce3-9ebd-7a512b0959e1 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:34.032097 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8a866aed-e33e-4ce3-9ebd-7a512b0959e1 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:34.040593 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8a866aed-e33e-4ce3-9ebd-7a512b0959e1 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1313 microversion: 2.1 time: 0.155146 Aug 22 12:48:34.041571 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 128/255] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:33 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:34.576964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3a2bf532-6051-4ddb-888a-1a367a716188 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:34.577613 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3a2bf532-6051-4ddb-888a-1a367a716188 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:34.584020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a2bf532-6051-4ddb-888a-1a367a716188 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:34.584511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a2bf532-6051-4ddb-888a-1a367a716188 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:34.584956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a2bf532-6051-4ddb-888a-1a367a716188 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:34.585652 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a2bf532-6051-4ddb-888a-1a367a716188 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:34.586117 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a2bf532-6051-4ddb-888a-1a367a716188 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:34.586578 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a2bf532-6051-4ddb-888a-1a367a716188 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:34.738539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3a2bf532-6051-4ddb-888a-1a367a716188 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:34.748051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3a2bf532-6051-4ddb-888a-1a367a716188 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.175052 Aug 22 12:48:34.748623 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 128/256] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:34 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:35.061348 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-449c525a-801a-49b8-ad88-1b6e5122da5c tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:35.061966 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-449c525a-801a-49b8-ad88-1b6e5122da5c tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:35.067983 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-449c525a-801a-49b8-ad88-1b6e5122da5c tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:35.068474 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-449c525a-801a-49b8-ad88-1b6e5122da5c tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:35.068909 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-449c525a-801a-49b8-ad88-1b6e5122da5c tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:35.069607 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-449c525a-801a-49b8-ad88-1b6e5122da5c tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:35.070066 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-449c525a-801a-49b8-ad88-1b6e5122da5c tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:35.070524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-449c525a-801a-49b8-ad88-1b6e5122da5c tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:35.196705 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-449c525a-801a-49b8-ad88-1b6e5122da5c tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:35.204726 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-449c525a-801a-49b8-ad88-1b6e5122da5c tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1313 microversion: 2.1 time: 0.147144 Aug 22 12:48:35.205232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 129/257] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:35 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:35.774312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-162d6f22-f3f4-407a-849b-4452271559f6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:35.774312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-162d6f22-f3f4-407a-849b-4452271559f6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:35.776576 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-162d6f22-f3f4-407a-849b-4452271559f6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:35.777068 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-162d6f22-f3f4-407a-849b-4452271559f6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:35.777672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-162d6f22-f3f4-407a-849b-4452271559f6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:35.779247 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-162d6f22-f3f4-407a-849b-4452271559f6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:35.780004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-162d6f22-f3f4-407a-849b-4452271559f6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:35.780441 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-162d6f22-f3f4-407a-849b-4452271559f6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:35.930342 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-162d6f22-f3f4-407a-849b-4452271559f6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:35.938538 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-162d6f22-f3f4-407a-849b-4452271559f6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.173571 Aug 22 12:48:35.939103 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 129/258] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:35 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:36.224958 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b7ef7dd8-cf0c-4b64-8614-31af805a38da tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:36.225572 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b7ef7dd8-cf0c-4b64-8614-31af805a38da tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:36.232863 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7ef7dd8-cf0c-4b64-8614-31af805a38da tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:36.233569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7ef7dd8-cf0c-4b64-8614-31af805a38da tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:36.234165 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7ef7dd8-cf0c-4b64-8614-31af805a38da tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:36.235052 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7ef7dd8-cf0c-4b64-8614-31af805a38da tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:36.235659 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7ef7dd8-cf0c-4b64-8614-31af805a38da tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:36.236243 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7ef7dd8-cf0c-4b64-8614-31af805a38da tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:36.390236 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b7ef7dd8-cf0c-4b64-8614-31af805a38da tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:36.398128 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b7ef7dd8-cf0c-4b64-8614-31af805a38da tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1313 microversion: 2.1 time: 0.177141 Aug 22 12:48:36.398741 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 130/259] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:36 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:36.960106 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-149fde64-bf68-4ccb-80d4-c2477d6305e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:36.960739 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-149fde64-bf68-4ccb-80d4-c2477d6305e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:36.967418 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-149fde64-bf68-4ccb-80d4-c2477d6305e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:36.967987 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-149fde64-bf68-4ccb-80d4-c2477d6305e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:36.969146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-149fde64-bf68-4ccb-80d4-c2477d6305e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:36.969937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-149fde64-bf68-4ccb-80d4-c2477d6305e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:36.970632 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-149fde64-bf68-4ccb-80d4-c2477d6305e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:36.971278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-149fde64-bf68-4ccb-80d4-c2477d6305e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:37.134346 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-149fde64-bf68-4ccb-80d4-c2477d6305e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:37.142506 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-149fde64-bf68-4ccb-80d4-c2477d6305e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.186447 Aug 22 12:48:37.143068 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 130/260] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:36 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:37.419651 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-55f81284-f240-45a9-9a56-aa814e9489e8 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:37.420308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-55f81284-f240-45a9-9a56-aa814e9489e8 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:37.427062 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55f81284-f240-45a9-9a56-aa814e9489e8 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:37.427062 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55f81284-f240-45a9-9a56-aa814e9489e8 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:37.427292 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55f81284-f240-45a9-9a56-aa814e9489e8 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:37.427863 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55f81284-f240-45a9-9a56-aa814e9489e8 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:37.428316 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55f81284-f240-45a9-9a56-aa814e9489e8 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:37.428734 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55f81284-f240-45a9-9a56-aa814e9489e8 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:37.574144 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-55f81284-f240-45a9-9a56-aa814e9489e8 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:37.584856 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-55f81284-f240-45a9-9a56-aa814e9489e8 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1313 microversion: 2.1 time: 0.169684 Aug 22 12:48:37.585424 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 131/261] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:37 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:38.163673 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-07181d42-8bc8-418b-8bf4-5f1eb210343d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:38.164419 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-07181d42-8bc8-418b-8bf4-5f1eb210343d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:38.171390 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-07181d42-8bc8-418b-8bf4-5f1eb210343d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:38.171884 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-07181d42-8bc8-418b-8bf4-5f1eb210343d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:38.172337 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-07181d42-8bc8-418b-8bf4-5f1eb210343d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:38.173146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-07181d42-8bc8-418b-8bf4-5f1eb210343d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:38.173607 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-07181d42-8bc8-418b-8bf4-5f1eb210343d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:38.174044 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-07181d42-8bc8-418b-8bf4-5f1eb210343d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:38.331866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-07181d42-8bc8-418b-8bf4-5f1eb210343d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:38.339780 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-07181d42-8bc8-418b-8bf4-5f1eb210343d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.180184 Aug 22 12:48:38.340427 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 131/262] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:38 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:38.609308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b5ef477b-4a53-4e68-992d-008f103acfcc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:38.609913 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b5ef477b-4a53-4e68-992d-008f103acfcc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:38.616042 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5ef477b-4a53-4e68-992d-008f103acfcc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:38.616524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5ef477b-4a53-4e68-992d-008f103acfcc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:38.617079 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5ef477b-4a53-4e68-992d-008f103acfcc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:38.617975 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5ef477b-4a53-4e68-992d-008f103acfcc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:38.618549 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5ef477b-4a53-4e68-992d-008f103acfcc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:38.619108 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5ef477b-4a53-4e68-992d-008f103acfcc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:38.765464 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b5ef477b-4a53-4e68-992d-008f103acfcc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:38.773148 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b5ef477b-4a53-4e68-992d-008f103acfcc tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1313 microversion: 2.1 time: 0.168454 Aug 22 12:48:38.774993 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 132/263] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:38 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:39.362394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-72792d7f-7233-4835-a28c-ec63edba7a32 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:39.362394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-72792d7f-7233-4835-a28c-ec63edba7a32 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:39.368289 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72792d7f-7233-4835-a28c-ec63edba7a32 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:39.368975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72792d7f-7233-4835-a28c-ec63edba7a32 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:39.369607 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72792d7f-7233-4835-a28c-ec63edba7a32 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:39.370304 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72792d7f-7233-4835-a28c-ec63edba7a32 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:39.370767 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72792d7f-7233-4835-a28c-ec63edba7a32 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:39.371231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-72792d7f-7233-4835-a28c-ec63edba7a32 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:39.518119 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-72792d7f-7233-4835-a28c-ec63edba7a32 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:39.526272 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-72792d7f-7233-4835-a28c-ec63edba7a32 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.169047 Aug 22 12:48:39.527342 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 132/264] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:39 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:39.794560 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c9fe36c4-a329-4bb6-bed3-3f75e773299a tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:39.795172 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c9fe36c4-a329-4bb6-bed3-3f75e773299a tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:39.801125 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c9fe36c4-a329-4bb6-bed3-3f75e773299a tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:39.801644 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c9fe36c4-a329-4bb6-bed3-3f75e773299a tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:39.802075 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c9fe36c4-a329-4bb6-bed3-3f75e773299a tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:39.802790 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c9fe36c4-a329-4bb6-bed3-3f75e773299a tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:39.803270 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c9fe36c4-a329-4bb6-bed3-3f75e773299a tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:39.803796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c9fe36c4-a329-4bb6-bed3-3f75e773299a tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:39.932513 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c9fe36c4-a329-4bb6-bed3-3f75e773299a tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:39.940185 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c9fe36c4-a329-4bb6-bed3-3f75e773299a tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1462 microversion: 2.1 time: 0.150020 Aug 22 12:48:39.946762 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 133/265] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:39 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1462 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:39.999224 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6e9017e7-b16d-4a1c-8fbb-5bc2d0027509 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:39.999727 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6e9017e7-b16d-4a1c-8fbb-5bc2d0027509 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:40.005582 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e9017e7-b16d-4a1c-8fbb-5bc2d0027509 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:40.006069 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e9017e7-b16d-4a1c-8fbb-5bc2d0027509 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:40.006535 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e9017e7-b16d-4a1c-8fbb-5bc2d0027509 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:40.007226 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e9017e7-b16d-4a1c-8fbb-5bc2d0027509 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:40.007684 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e9017e7-b16d-4a1c-8fbb-5bc2d0027509 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:40.008110 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e9017e7-b16d-4a1c-8fbb-5bc2d0027509 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:40.032807 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6e9017e7-b16d-4a1c-8fbb-5bc2d0027509 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Going to try to terminate instance {{(pid=127810) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:48:40.047307 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=100 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:40.445911 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6e9017e7-b16d-4a1c-8fbb-5bc2d0027509 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 204 len: 0 microversion: 2.1 time: 0.450330 Aug 22 12:48:40.455547 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-cdcd1f10-488d-4f3e-9786-65ffa3451b35 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:40.456159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-cdcd1f10-488d-4f3e-9786-65ffa3451b35 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:40.459343 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 133/266] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:48:39 2022] DELETE /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:48:40.462860 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdcd1f10-488d-4f3e-9786-65ffa3451b35 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:40.463346 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdcd1f10-488d-4f3e-9786-65ffa3451b35 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:40.463777 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdcd1f10-488d-4f3e-9786-65ffa3451b35 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:40.464472 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdcd1f10-488d-4f3e-9786-65ffa3451b35 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:40.464927 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdcd1f10-488d-4f3e-9786-65ffa3451b35 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:40.465351 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdcd1f10-488d-4f3e-9786-65ffa3451b35 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:40.548050 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-dedb747a-58f2-449e-a8e2-4aa3ed6155b3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:40.548750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-dedb747a-58f2-449e-a8e2-4aa3ed6155b3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:40.569296 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dedb747a-58f2-449e-a8e2-4aa3ed6155b3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:40.569437 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dedb747a-58f2-449e-a8e2-4aa3ed6155b3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:40.569951 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dedb747a-58f2-449e-a8e2-4aa3ed6155b3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:40.570770 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dedb747a-58f2-449e-a8e2-4aa3ed6155b3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:40.571411 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dedb747a-58f2-449e-a8e2-4aa3ed6155b3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:40.572419 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dedb747a-58f2-449e-a8e2-4aa3ed6155b3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:40.616474 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-cdcd1f10-488d-4f3e-9786-65ffa3451b35 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:40.632637 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-cdcd1f10-488d-4f3e-9786-65ffa3451b35 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1468 microversion: 2.1 time: 0.180681 Aug 22 12:48:40.633225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 134/267] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:40 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1468 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:40.728634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-dedb747a-58f2-449e-a8e2-4aa3ed6155b3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:40.738143 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-dedb747a-58f2-449e-a8e2-4aa3ed6155b3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.194236 Aug 22 12:48:40.738751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 134/268] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:40 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:41.657694 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b6e024fa-de0d-470a-a92e-c4482d5397d9 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:41.659026 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b6e024fa-de0d-470a-a92e-c4482d5397d9 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:41.665042 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b6e024fa-de0d-470a-a92e-c4482d5397d9 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:41.665525 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b6e024fa-de0d-470a-a92e-c4482d5397d9 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:41.665953 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b6e024fa-de0d-470a-a92e-c4482d5397d9 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:41.666745 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b6e024fa-de0d-470a-a92e-c4482d5397d9 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:41.667197 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b6e024fa-de0d-470a-a92e-c4482d5397d9 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:41.667619 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b6e024fa-de0d-470a-a92e-c4482d5397d9 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:41.672292 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:41.759499 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e4f63881-a8f0-4bf8-a693-0022d0a98d65 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:41.760115 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e4f63881-a8f0-4bf8-a693-0022d0a98d65 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:41.766836 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e4f63881-a8f0-4bf8-a693-0022d0a98d65 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:41.767322 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e4f63881-a8f0-4bf8-a693-0022d0a98d65 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:41.767750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e4f63881-a8f0-4bf8-a693-0022d0a98d65 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:41.768497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e4f63881-a8f0-4bf8-a693-0022d0a98d65 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:41.769019 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e4f63881-a8f0-4bf8-a693-0022d0a98d65 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:41.769621 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e4f63881-a8f0-4bf8-a693-0022d0a98d65 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:41.804412 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b6e024fa-de0d-470a-a92e-c4482d5397d9 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:41.812445 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b6e024fa-de0d-470a-a92e-c4482d5397d9 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1468 microversion: 2.1 time: 0.159803 Aug 22 12:48:41.813021 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 135/269] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:41 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1468 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:41.905678 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e4f63881-a8f0-4bf8-a693-0022d0a98d65 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:41.914270 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e4f63881-a8f0-4bf8-a693-0022d0a98d65 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.158742 Aug 22 12:48:41.914837 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 135/270] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:41 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:42.834171 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8ffbe883-1570-4705-844f-18d85fba3488 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:42.837492 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8ffbe883-1570-4705-844f-18d85fba3488 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:42.844205 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ffbe883-1570-4705-844f-18d85fba3488 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:42.845372 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ffbe883-1570-4705-844f-18d85fba3488 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:42.846061 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ffbe883-1570-4705-844f-18d85fba3488 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:42.848069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ffbe883-1570-4705-844f-18d85fba3488 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:42.848804 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ffbe883-1570-4705-844f-18d85fba3488 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:42.849453 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ffbe883-1570-4705-844f-18d85fba3488 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:42.935283 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b9844ec2-b1fe-42c0-9d0f-a471fa7863f3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:42.935892 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b9844ec2-b1fe-42c0-9d0f-a471fa7863f3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:42.951784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b9844ec2-b1fe-42c0-9d0f-a471fa7863f3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:42.952600 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b9844ec2-b1fe-42c0-9d0f-a471fa7863f3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:42.953261 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b9844ec2-b1fe-42c0-9d0f-a471fa7863f3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:42.954159 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b9844ec2-b1fe-42c0-9d0f-a471fa7863f3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:42.954654 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b9844ec2-b1fe-42c0-9d0f-a471fa7863f3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:42.955083 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b9844ec2-b1fe-42c0-9d0f-a471fa7863f3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:43.068881 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8ffbe883-1570-4705-844f-18d85fba3488 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:43.077357 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8ffbe883-1570-4705-844f-18d85fba3488 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1468 microversion: 2.1 time: 0.247030 Aug 22 12:48:43.095989 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 136/271] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:42 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1468 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:43.230843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b9844ec2-b1fe-42c0-9d0f-a471fa7863f3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:43.239331 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b9844ec2-b1fe-42c0-9d0f-a471fa7863f3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.307870 Aug 22 12:48:43.240232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 136/272] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:42 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:43.333829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-aa4de91a-93d1-476e-9e46-306219e74fe7 req-aa2075a2-d3d3-4aa7-ae1c-028db69f328b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8815c98-2103-46be-a369-354aabce8da3", "name": "network-vif-deleted", "tag": "30f79507-9674-4813-876b-1ebafdfdee63"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:43.344844 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-aa4de91a-93d1-476e-9e46-306219e74fe7 req-aa2075a2-d3d3-4aa7-ae1c-028db69f328b service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:43.345674 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-aa4de91a-93d1-476e-9e46-306219e74fe7 req-aa2075a2-d3d3-4aa7-ae1c-028db69f328b service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:43.346322 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-aa4de91a-93d1-476e-9e46-306219e74fe7 req-aa2075a2-d3d3-4aa7-ae1c-028db69f328b service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:43.361370 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-aa4de91a-93d1-476e-9e46-306219e74fe7 req-aa2075a2-d3d3-4aa7-ae1c-028db69f328b service nova] Creating event network-vif-deleted:30f79507-9674-4813-876b-1ebafdfdee63 for instance d8815c98-2103-46be-a369-354aabce8da3 on hv-cinder-85083 Aug 22 12:48:43.367214 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-aa4de91a-93d1-476e-9e46-306219e74fe7 req-aa2075a2-d3d3-4aa7-ae1c-028db69f328b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037292 Aug 22 12:48:43.367910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 137/273] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:48:44.102213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:44.102750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:44.109340 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:44.109833 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:44.110286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:44.110969 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:44.111456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:44.112003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:44.142464 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:44.142935 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:44.143365 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:44.143806 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lazy-loading 'fault' on Instance uuid d8815c98-2103-46be-a369-354aabce8da3 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:48:44.191439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed492b61eb0e44c8b5ab7caf5cd2507c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8669fceab64144828ca5aab86b8f39b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:44.200386 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8ad7d6ef-df42-4552-a864-061d722083a3 tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 200 len: 1303 microversion: 2.1 time: 0.101487 Aug 22 12:48:44.201444 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 137/274] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:44 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:44.262201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-622920bd-96ac-4ea7-afd5-271c911cbee1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:44.263438 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-622920bd-96ac-4ea7-afd5-271c911cbee1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:44.269497 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-622920bd-96ac-4ea7-afd5-271c911cbee1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:44.269976 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-622920bd-96ac-4ea7-afd5-271c911cbee1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:44.270447 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-622920bd-96ac-4ea7-afd5-271c911cbee1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:44.271190 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-622920bd-96ac-4ea7-afd5-271c911cbee1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:44.271650 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-622920bd-96ac-4ea7-afd5-271c911cbee1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:44.272069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-622920bd-96ac-4ea7-afd5-271c911cbee1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:44.412771 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-622920bd-96ac-4ea7-afd5-271c911cbee1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:44.420769 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-622920bd-96ac-4ea7-afd5-271c911cbee1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.162882 Aug 22 12:48:44.445079 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 138/275] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:44 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:45.222302 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:45.222912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] [instance: d8815c98-2103-46be-a369-354aabce8da3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:45.229289 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:45.229772 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:45.230213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:45.230909 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:45.231985 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:45.232462 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:45.246356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] HTTP exception thrown: Instance d8815c98-2103-46be-a369-354aabce8da3 could not be found. Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Request method failure captured: Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 HTTP/1.1 Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3sR9f_FZDajVCl6J5qORNbdOF95EdGcCPC2VgO0ZnT2VMXQpxS57gjwoSFoFrGTy_ZIzalGR2K7PHJl0C2JDso0hja-_qoDhqnXGInuZtMHiAAmfTJyE8XaJl-cEINWSGvm0IG7sRegGgeWSOMVb0iQ8yYjzj1THin-sXJ6SeKpavk Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 8669fceab64144828ca5aab86b8f39b6 Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-VolumesNegativeTest-470712126 Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:48:45.248146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8669fceab64144828ca5aab86b8f39b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8669fceab64144828ca5aab86b8f39b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8669fceab64144828ca5aab86b8f39b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8669fceab64144828ca5aab86b8f39b6"}]}] Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-VolumesNegativeTest-470712126 Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 8669fceab64144828ca5aab86b8f39b6 Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-VolumesNegativeTest-470712126 Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-VolumesNegativeTest-470712126-project Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: ed492b61eb0e44c8b5ab7caf5cd2507c Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-VolumesNegativeTest-470712126-project Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance d8815c98-2103-46be-a369-354aabce8da3 could not be found. Aug 22 12:48:45.254024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': 'd8815c98-2103-46be-a369-354aabce8da3'} Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8815c98-2103-46be-a369-354aabce8da3 could not be found. Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:45.254956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8815c98-2103-46be-a369-354aabce8da3 could not be found. Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8815c98-2103-46be-a369-354aabce8da3 could not be found. Aug 22 12:48:45.256378 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:45.257628 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] Returning 404 to user: Instance d8815c98-2103-46be-a369-354aabce8da3 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:45.257628 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8a126301-c891-438d-99c4-a9d47d54793e tempest-VolumesNegativeTest-470712126 tempest-VolumesNegativeTest-470712126-project] 10.222.0.15 "GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3" status: 404 len: 111 microversion: 2.1 time: 0.032116 Aug 22 12:48:45.257628 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 138/276] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:45 2022] GET /compute/v2.1/servers/d8815c98-2103-46be-a369-354aabce8da3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 12:48:45.452573 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-06b94079-56f5-4c96-bfd3-5fb5c0dd338d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:45.453345 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-06b94079-56f5-4c96-bfd3-5fb5c0dd338d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:45.466523 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b94079-56f5-4c96-bfd3-5fb5c0dd338d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:45.467023 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b94079-56f5-4c96-bfd3-5fb5c0dd338d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:45.467454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b94079-56f5-4c96-bfd3-5fb5c0dd338d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:45.468345 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b94079-56f5-4c96-bfd3-5fb5c0dd338d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:45.468946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b94079-56f5-4c96-bfd3-5fb5c0dd338d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:45.469644 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b94079-56f5-4c96-bfd3-5fb5c0dd338d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:45.647925 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-06b94079-56f5-4c96-bfd3-5fb5c0dd338d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:45.656921 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-06b94079-56f5-4c96-bfd3-5fb5c0dd338d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.208301 Aug 22 12:48:45.657614 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 139/277] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:45 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:46.679536 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-44cf3b66-9a8d-40ae-8a37-7b1de4728092 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:46.680404 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-44cf3b66-9a8d-40ae-8a37-7b1de4728092 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:46.689018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44cf3b66-9a8d-40ae-8a37-7b1de4728092 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:46.689516 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44cf3b66-9a8d-40ae-8a37-7b1de4728092 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:46.689968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44cf3b66-9a8d-40ae-8a37-7b1de4728092 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:46.690719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44cf3b66-9a8d-40ae-8a37-7b1de4728092 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:46.691178 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44cf3b66-9a8d-40ae-8a37-7b1de4728092 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:46.691847 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44cf3b66-9a8d-40ae-8a37-7b1de4728092 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:46.866445 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-44cf3b66-9a8d-40ae-8a37-7b1de4728092 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:46.876919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-44cf3b66-9a8d-40ae-8a37-7b1de4728092 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.202039 Aug 22 12:48:46.886924 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 139/278] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:46 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:47.897806 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ff15b964-19b9-472f-ab69-3c1cf6ea5735 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:47.898402 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ff15b964-19b9-472f-ab69-3c1cf6ea5735 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:47.904326 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff15b964-19b9-472f-ab69-3c1cf6ea5735 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:47.904815 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff15b964-19b9-472f-ab69-3c1cf6ea5735 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:47.905257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff15b964-19b9-472f-ab69-3c1cf6ea5735 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:47.905955 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff15b964-19b9-472f-ab69-3c1cf6ea5735 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:47.906445 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff15b964-19b9-472f-ab69-3c1cf6ea5735 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:47.906892 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff15b964-19b9-472f-ab69-3c1cf6ea5735 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:48.038267 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ff15b964-19b9-472f-ab69-3c1cf6ea5735 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:48.046545 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ff15b964-19b9-472f-ab69-3c1cf6ea5735 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.152533 Aug 22 12:48:48.047112 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 140/279] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:47 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:49.069414 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-78379944-06df-4d71-aa5b-5b2bab911b10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:49.070140 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-78379944-06df-4d71-aa5b-5b2bab911b10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:49.078260 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-78379944-06df-4d71-aa5b-5b2bab911b10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:49.078975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-78379944-06df-4d71-aa5b-5b2bab911b10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:49.079506 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-78379944-06df-4d71-aa5b-5b2bab911b10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:49.080324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-78379944-06df-4d71-aa5b-5b2bab911b10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:49.081432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-78379944-06df-4d71-aa5b-5b2bab911b10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:49.082035 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-78379944-06df-4d71-aa5b-5b2bab911b10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:49.224552 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-78379944-06df-4d71-aa5b-5b2bab911b10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:49.232476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-78379944-06df-4d71-aa5b-5b2bab911b10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.166898 Aug 22 12:48:49.233032 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 140/280] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:49 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:50.053736 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7ecfdb45-b731-4b48-bb21-4be364f013ff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:50.054420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7ecfdb45-b731-4b48-bb21-4be364f013ff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:50.060127 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ecfdb45-b731-4b48-bb21-4be364f013ff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:50.060752 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ecfdb45-b731-4b48-bb21-4be364f013ff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:50.061196 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ecfdb45-b731-4b48-bb21-4be364f013ff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:50.061887 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ecfdb45-b731-4b48-bb21-4be364f013ff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:50.062381 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ecfdb45-b731-4b48-bb21-4be364f013ff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:50.062808 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ecfdb45-b731-4b48-bb21-4be364f013ff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:50.087623 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7ecfdb45-b731-4b48-bb21-4be364f013ff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/ips" status: 200 len: 152 microversion: 2.20 time: 0.037727 Aug 22 12:48:50.088395 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 141/281] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Aug 22 12:48:50 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:48:50.253093 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-79c6fbfb-f127-40c2-a5d5-ad103ab6cf6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:50.254003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-79c6fbfb-f127-40c2-a5d5-ad103ab6cf6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:50.260568 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79c6fbfb-f127-40c2-a5d5-ad103ab6cf6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:50.267890 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79c6fbfb-f127-40c2-a5d5-ad103ab6cf6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:50.268331 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79c6fbfb-f127-40c2-a5d5-ad103ab6cf6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:50.269251 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79c6fbfb-f127-40c2-a5d5-ad103ab6cf6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:50.269877 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79c6fbfb-f127-40c2-a5d5-ad103ab6cf6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:50.270331 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79c6fbfb-f127-40c2-a5d5-ad103ab6cf6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:50.433536 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-79c6fbfb-f127-40c2-a5d5-ad103ab6cf6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:50.455914 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-79c6fbfb-f127-40c2-a5d5-ad103ab6cf6d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.206576 Aug 22 12:48:50.456502 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 141/282] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:50 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:51.477856 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1616e58a-c9bb-4b86-8ab7-0150355ef08c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:51.478786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1616e58a-c9bb-4b86-8ab7-0150355ef08c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:51.484688 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1616e58a-c9bb-4b86-8ab7-0150355ef08c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:51.485167 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1616e58a-c9bb-4b86-8ab7-0150355ef08c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:51.485595 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1616e58a-c9bb-4b86-8ab7-0150355ef08c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:51.486301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1616e58a-c9bb-4b86-8ab7-0150355ef08c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:51.486750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1616e58a-c9bb-4b86-8ab7-0150355ef08c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:51.487170 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1616e58a-c9bb-4b86-8ab7-0150355ef08c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:51.619205 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1616e58a-c9bb-4b86-8ab7-0150355ef08c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:51.627482 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1616e58a-c9bb-4b86-8ab7-0150355ef08c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.153358 Aug 22 12:48:51.628035 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 142/283] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:51 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:52.647674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e691d2cb-3770-468e-a09c-1fed18510856 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:52.648309 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e691d2cb-3770-468e-a09c-1fed18510856 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:52.655181 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e691d2cb-3770-468e-a09c-1fed18510856 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:52.655664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e691d2cb-3770-468e-a09c-1fed18510856 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:52.656098 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e691d2cb-3770-468e-a09c-1fed18510856 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:52.656793 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e691d2cb-3770-468e-a09c-1fed18510856 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:52.657249 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e691d2cb-3770-468e-a09c-1fed18510856 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:52.657672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e691d2cb-3770-468e-a09c-1fed18510856 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:52.834249 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e691d2cb-3770-468e-a09c-1fed18510856 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:52.853564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e691d2cb-3770-468e-a09c-1fed18510856 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.209346 Aug 22 12:48:52.854412 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 142/284] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:52 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:53.239241 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7c98aa1d-1e57-4304-85bb-b3ee1be17292 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:53.239787 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7c98aa1d-1e57-4304-85bb-b3ee1be17292 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:53.251800 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c98aa1d-1e57-4304-85bb-b3ee1be17292 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:53.251800 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c98aa1d-1e57-4304-85bb-b3ee1be17292 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:53.251800 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c98aa1d-1e57-4304-85bb-b3ee1be17292 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:53.251800 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c98aa1d-1e57-4304-85bb-b3ee1be17292 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:53.252203 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c98aa1d-1e57-4304-85bb-b3ee1be17292 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:53.252203 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c98aa1d-1e57-4304-85bb-b3ee1be17292 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:53.271314 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-7c98aa1d-1e57-4304-85bb-b3ee1be17292 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lazy-loading 'flavor' on Instance uuid 4e060778-7e35-44e9-99f4-f2fb64f07928 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:48:53.770296 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-69824e40-2ce8-4f8d-a09d-d16368edbcea tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:53.770843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-69824e40-2ce8-4f8d-a09d-d16368edbcea tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:53.783143 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69824e40-2ce8-4f8d-a09d-d16368edbcea tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:53.783826 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69824e40-2ce8-4f8d-a09d-d16368edbcea tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:53.784329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69824e40-2ce8-4f8d-a09d-d16368edbcea tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:53.785174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69824e40-2ce8-4f8d-a09d-d16368edbcea tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:53.785976 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69824e40-2ce8-4f8d-a09d-d16368edbcea tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:53.786556 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69824e40-2ce8-4f8d-a09d-d16368edbcea tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:53.823009 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-69824e40-2ce8-4f8d-a09d-d16368edbcea tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/ips" status: 200 len: 146 microversion: 2.1 time: 0.056756 Aug 22 12:48:53.823697 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 143/285] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 22 12:48:53 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/ips => generated 146 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:48:53.880485 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f4780e67-335e-489d-b245-3d53e25b154c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:53.881591 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f4780e67-335e-489d-b245-3d53e25b154c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:53.891768 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f4780e67-335e-489d-b245-3d53e25b154c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:53.892550 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f4780e67-335e-489d-b245-3d53e25b154c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:53.893187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f4780e67-335e-489d-b245-3d53e25b154c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:53.895137 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f4780e67-335e-489d-b245-3d53e25b154c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:53.895790 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f4780e67-335e-489d-b245-3d53e25b154c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:53.896496 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f4780e67-335e-489d-b245-3d53e25b154c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:53.918935 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7c98aa1d-1e57-4304-85bb-b3ee1be17292 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "POST /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/action" status: 202 len: 0 microversion: 2.20 time: 0.683421 Aug 22 12:48:53.920645 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 143/286] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 22 12:48:53 2022] POST /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:48:53.944092 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:53.947059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:53.961451 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=54 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:53.963544 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:53.968478 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:53.969200 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:53.970248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:53.970913 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:53.975720 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:54.143529 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f4780e67-335e-489d-b245-3d53e25b154c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:54.154056 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f4780e67-335e-489d-b245-3d53e25b154c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.279685 Aug 22 12:48:54.154845 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 144/287] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:53 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:54.211332 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:54.219609 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:54.221108 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:54.222408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-111d5e10-73e3-443b-a7b2-1181fa5b97e5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.294939 Aug 22 12:48:54.223177 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 144/288] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:48:53 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:48:55.175082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a20e5967-ec85-4a9d-8bcc-2406c545447b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:55.175789 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a20e5967-ec85-4a9d-8bcc-2406c545447b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:55.182447 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a20e5967-ec85-4a9d-8bcc-2406c545447b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:55.183135 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a20e5967-ec85-4a9d-8bcc-2406c545447b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:55.183581 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a20e5967-ec85-4a9d-8bcc-2406c545447b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:55.184784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a20e5967-ec85-4a9d-8bcc-2406c545447b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:55.185261 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a20e5967-ec85-4a9d-8bcc-2406c545447b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:55.185726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a20e5967-ec85-4a9d-8bcc-2406c545447b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:55.257382 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:55.258961 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:55.274938 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:55.275587 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:55.276024 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:55.276908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:55.277452 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:55.278409 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:55.356965 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a20e5967-ec85-4a9d-8bcc-2406c545447b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:55.365509 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a20e5967-ec85-4a9d-8bcc-2406c545447b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.194441 Aug 22 12:48:55.366337 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 145/289] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:55 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:55.424681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:55.432733 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:55.434774 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:55.435926 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a4012899-88cd-4e83-b130-ea99c975cd85 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.193708 Aug 22 12:48:55.436485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 145/290] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:48:55 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:48:56.387703 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-fb388b68-1610-4d02-bae6-6e5a6a31f380 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:56.388251 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-fb388b68-1610-4d02-bae6-6e5a6a31f380 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:56.396078 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb388b68-1610-4d02-bae6-6e5a6a31f380 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:56.396582 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb388b68-1610-4d02-bae6-6e5a6a31f380 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:56.397029 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb388b68-1610-4d02-bae6-6e5a6a31f380 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:56.397777 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb388b68-1610-4d02-bae6-6e5a6a31f380 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:56.398237 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb388b68-1610-4d02-bae6-6e5a6a31f380 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:56.398679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb388b68-1610-4d02-bae6-6e5a6a31f380 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:56.459449 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:56.460094 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:56.469022 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:56.470496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:56.471222 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:56.471797 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:56.472257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:56.472678 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:56.679110 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-fb388b68-1610-4d02-bae6-6e5a6a31f380 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:56.687735 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-fb388b68-1610-4d02-bae6-6e5a6a31f380 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1502 microversion: 2.1 time: 0.304447 Aug 22 12:48:56.688363 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 146/291] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:56 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:56.695885 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:56.705257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:56.707017 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:56.708985 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f449148-a1b0-4f2e-9f85-6d251e1654dd"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:56.711431 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:56.717637 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:56.717916 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:56.718524 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:56.719354 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:56.719868 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-226cd181-736f-4b76-9bb3-fb2c122f56f6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.264562 Aug 22 12:48:56.720085 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:56.720441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 146/292] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:48:56 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:48:56.731920 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:56.755807 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] HTTP exception thrown: Cannot 'attach_volume' instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 while it is in vm_state rescued Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Request method failure captured: Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: POST /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6/os-volume_attachments HTTP/1.1 Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 74 Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rHTwMTo6zGt_ez_vmdEnfXSSDlW_ImyAeBjZj5lPt9LtxzxK-5VBTsf3eRd136OGLX0aofzvbz2KqrBKfOr6yVt5iXGUXXbBLQCzrCJRuuhXMl3GBJuSZzIjP1u4jmmlxE81HPMY7Casqzy1V5P9wc5vH205JPMnat-aavB0Eamzk Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 30bf0498eabd4d9988b2084c0b082fad Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:48:56.757446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30bf0498eabd4d9988b2084c0b082fad"}]}] Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 30bf0498eabd4d9988b2084c0b082fad Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-ServerRescueNegativeTestJSON-93198942-project Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 9767d18cf0944f16b45fff4214128c1a Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-93198942-project Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {"volumeAttachment": {"volumeId": "4f449148-a1b0-4f2e-9f85-6d251e1654dd"}} Aug 22 12:48:56.758948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Cannot 'attach_volume' instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 while it is in vm_state rescued Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'server_id': '3fb90990-6e18-45a2-88c4-b725b54a21d6', 'body': {'volumeAttachment': {'volumeId': '4f449148-a1b0-4f2e-9f85-6d251e1654dd'}}} Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:48:56.759822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 while it is in vm_state rescued Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:48:56.761096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:48:56.762933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:48:56.762933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:48:56.762933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 while it is in vm_state rescued Aug 22 12:48:56.762933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:48:56.762933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Returning 409 to user: Cannot 'attach_volume' instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 while it is in vm_state rescued {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:48:56.762933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1da883f8-89ca-4dc2-8767-37c7ebebf8f7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "POST /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053790 Aug 22 12:48:56.762933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 147/293] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:48:56 2022] POST /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 22 12:48:56.769115 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6e37f86c-48ab-4f7c-b0a6-5b991fb3bd08 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:56.769850 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6e37f86c-48ab-4f7c-b0a6-5b991fb3bd08 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:56.776050 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e37f86c-48ab-4f7c-b0a6-5b991fb3bd08 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:56.776631 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e37f86c-48ab-4f7c-b0a6-5b991fb3bd08 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:56.777160 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e37f86c-48ab-4f7c-b0a6-5b991fb3bd08 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:56.777967 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e37f86c-48ab-4f7c-b0a6-5b991fb3bd08 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:56.778532 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e37f86c-48ab-4f7c-b0a6-5b991fb3bd08 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:56.779030 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e37f86c-48ab-4f7c-b0a6-5b991fb3bd08 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:57.139930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6e37f86c-48ab-4f7c-b0a6-5b991fb3bd08 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "POST /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6/action" status: 202 len: 0 microversion: 2.1 time: 0.374804 Aug 22 12:48:57.143904 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 147/294] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 12:48:56 2022] POST /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:48:57.149034 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-98b1af83-07bb-4469-9355-cd320e56b251 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:57.154285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-98b1af83-07bb-4469-9355-cd320e56b251 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:57.156437 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98b1af83-07bb-4469-9355-cd320e56b251 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:57.156931 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98b1af83-07bb-4469-9355-cd320e56b251 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:57.157361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98b1af83-07bb-4469-9355-cd320e56b251 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:57.158242 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98b1af83-07bb-4469-9355-cd320e56b251 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:57.158700 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98b1af83-07bb-4469-9355-cd320e56b251 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:57.159435 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98b1af83-07bb-4469-9355-cd320e56b251 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:57.352035 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-98b1af83-07bb-4469-9355-cd320e56b251 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:57.363778 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-98b1af83-07bb-4469-9355-cd320e56b251 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1510 microversion: 2.1 time: 0.218347 Aug 22 12:48:57.371843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 148/295] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:57 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:48:57.744393 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:57.745133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:57.752007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:57.752622 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:57.753128 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:57.753920 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:57.754497 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:57.754992 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:57.918711 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-64cf9031-a654-446d-906b-bd814d896e26 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d312228b-588a-4b62-ad78-0000eddfbe68"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:48:57.921946 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-64cf9031-a654-446d-906b-bd814d896e26 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:57.938874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64cf9031-a654-446d-906b-bd814d896e26 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:57.939283 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64cf9031-a654-446d-906b-bd814d896e26 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:57.939898 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64cf9031-a654-446d-906b-bd814d896e26 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:57.940809 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64cf9031-a654-446d-906b-bd814d896e26 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:57.941417 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64cf9031-a654-446d-906b-bd814d896e26 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:57.941998 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64cf9031-a654-446d-906b-bd814d896e26 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:57.977492 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:57.988214 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:57.990407 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:57.998821 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6822420b-dad1-4558-9dde-1c6b533f2257 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.253768 Aug 22 12:48:58.000593 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 148/296] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:48:57 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:48:58.392342 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-efe20538-d7d9-4f3d-af0b-f043ea52f481 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:58.393340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-efe20538-d7d9-4f3d-af0b-f043ea52f481 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:58.403953 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-efe20538-d7d9-4f3d-af0b-f043ea52f481 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:58.404724 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-efe20538-d7d9-4f3d-af0b-f043ea52f481 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:58.406269 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-efe20538-d7d9-4f3d-af0b-f043ea52f481 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:58.407420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-efe20538-d7d9-4f3d-af0b-f043ea52f481 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:58.408491 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-efe20538-d7d9-4f3d-af0b-f043ea52f481 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:58.409086 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-efe20538-d7d9-4f3d-af0b-f043ea52f481 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:58.604551 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-efe20538-d7d9-4f3d-af0b-f043ea52f481 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:58.608209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:58.613061 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-efe20538-d7d9-4f3d-af0b-f043ea52f481 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1510 microversion: 2.1 time: 0.226746 Aug 22 12:48:58.613634 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 149/297] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:58 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:48:59.023326 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:59.023952 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:59.030200 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:59.030739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:59.031177 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:59.031875 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:59.032340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:59.032767 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:59.176510 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:59.185232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:59.187039 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:59.188204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e847f4b1-48a2-46bc-a995-4dd1ce0b5e7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.168953 Aug 22 12:48:59.188744 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 150/298] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:48:59 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:48:59.639110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0cc939ea-edd0-4f55-a225-4301e232cd02 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:48:59.639743 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0cc939ea-edd0-4f55-a225-4301e232cd02 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:48:59.646090 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cc939ea-edd0-4f55-a225-4301e232cd02 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:59.646629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cc939ea-edd0-4f55-a225-4301e232cd02 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:59.647065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cc939ea-edd0-4f55-a225-4301e232cd02 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:59.647777 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cc939ea-edd0-4f55-a225-4301e232cd02 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:48:59.648237 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cc939ea-edd0-4f55-a225-4301e232cd02 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:48:59.648741 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cc939ea-edd0-4f55-a225-4301e232cd02 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:48:59.781882 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0cc939ea-edd0-4f55-a225-4301e232cd02 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:48:59.793920 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0cc939ea-edd0-4f55-a225-4301e232cd02 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1510 microversion: 2.1 time: 0.155102 Aug 22 12:48:59.793920 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 151/299] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:48:59 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:49:00.211277 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:00.212748 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:00.218586 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:00.219258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:00.219692 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:00.220560 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:00.221031 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:00.221461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:00.369688 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:00.380179 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:00.381849 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:00.383020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-79a2633b-f2e1-4196-ba50-11987ef3b57c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.175653 Aug 22 12:49:00.383568 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 152/300] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:00 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:00.817027 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0cae4446-0cb9-4dcc-8e9a-38a7533dcf88 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:00.817662 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0cae4446-0cb9-4dcc-8e9a-38a7533dcf88 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:00.825094 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cae4446-0cb9-4dcc-8e9a-38a7533dcf88 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:00.826021 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cae4446-0cb9-4dcc-8e9a-38a7533dcf88 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:00.826506 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cae4446-0cb9-4dcc-8e9a-38a7533dcf88 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:00.827226 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cae4446-0cb9-4dcc-8e9a-38a7533dcf88 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:00.827691 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cae4446-0cb9-4dcc-8e9a-38a7533dcf88 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:00.828126 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0cae4446-0cb9-4dcc-8e9a-38a7533dcf88 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:00.963944 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0cae4446-0cb9-4dcc-8e9a-38a7533dcf88 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:00.971993 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0cae4446-0cb9-4dcc-8e9a-38a7533dcf88 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1510 microversion: 2.1 time: 0.163121 Aug 22 12:49:00.972684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 153/301] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:00 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:49:01.405544 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:01.406199 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:01.412610 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:01.413033 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:01.413469 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:01.414302 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:01.414764 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:01.415188 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:01.567993 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:01.578023 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:01.580309 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:01.581021 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e5e99025-5ab7-48e1-aba2-002577bb2b63 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.179837 Aug 22 12:49:01.581770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 154/302] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:01 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:01.884704 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:01.993566 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0c63c3fe-8d60-416e-9d92-12d504ed1963 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:01.994209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0c63c3fe-8d60-416e-9d92-12d504ed1963 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:02.000723 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c63c3fe-8d60-416e-9d92-12d504ed1963 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:02.001282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c63c3fe-8d60-416e-9d92-12d504ed1963 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:02.001895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c63c3fe-8d60-416e-9d92-12d504ed1963 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:02.002623 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c63c3fe-8d60-416e-9d92-12d504ed1963 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:02.003085 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c63c3fe-8d60-416e-9d92-12d504ed1963 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:02.003506 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c63c3fe-8d60-416e-9d92-12d504ed1963 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:02.147479 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0c63c3fe-8d60-416e-9d92-12d504ed1963 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:02.157265 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0c63c3fe-8d60-416e-9d92-12d504ed1963 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1510 microversion: 2.1 time: 0.167616 Aug 22 12:49:02.171267 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 155/303] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:01 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:02.584659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-64cf9031-a654-446d-906b-bd814d896e26 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "POST /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.670545 Aug 22 12:49:02.585498 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 149/304] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:48:57 2022] POST /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/os-volume_attachments => generated 194 bytes in 4672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:49:02.607142 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:02.607859 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:02.617976 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:02.620113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:02.620630 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:02.623663 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:02.625065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:02.625519 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:02.905910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:02.914071 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:02.915614 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:02.917102 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e9dfe9a2-a8f4-4343-9228-98a44c2391b6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.315983 Aug 22 12:49:02.917663 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 156/305] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:02 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:03.186484 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-faea798b-2eb6-4d0a-afcb-c49f77b127ea tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:03.187219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-faea798b-2eb6-4d0a-afcb-c49f77b127ea tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:03.195383 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:03.197641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-faea798b-2eb6-4d0a-afcb-c49f77b127ea tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:03.198485 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-faea798b-2eb6-4d0a-afcb-c49f77b127ea tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:03.201168 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-faea798b-2eb6-4d0a-afcb-c49f77b127ea tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:03.203097 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-faea798b-2eb6-4d0a-afcb-c49f77b127ea tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:03.204082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-faea798b-2eb6-4d0a-afcb-c49f77b127ea tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:03.204666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-faea798b-2eb6-4d0a-afcb-c49f77b127ea tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:03.417306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-faea798b-2eb6-4d0a-afcb-c49f77b127ea tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:03.425980 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-faea798b-2eb6-4d0a-afcb-c49f77b127ea tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1516 microversion: 2.1 time: 0.247201 Aug 22 12:49:03.426937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 150/306] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:03 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:03.940700 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:03.941499 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:03.947624 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:03.948119 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:03.948562 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:03.949841 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:03.950294 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:03.950720 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:04.146017 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:04.156875 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:04.160528 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:04.169430 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c1a9728d-882e-41c6-8c3b-67a6012ec805 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.232586 Aug 22 12:49:04.170030 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 157/307] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:03 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:05.194942 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:05.195586 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:05.203214 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:05.203703 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:05.204139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:05.204836 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:05.205295 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:05.205719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:05.589290 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:05.600963 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:05.603599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:05.606306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c317c009-6fbf-466c-bd99-22cea2025d7c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.414881 Aug 22 12:49:05.618964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 151/308] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:05 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:05.689053 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-850a20f4-90ea-4e16-9f25-82ee1231ee99 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Action: 'create', calling method: .version_select at 0x7f7659f07280>, body: {"keypair": {"name": "tempest-keypair-1984327608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlxbsFgTDM/V1Rtp1d/u/w+4lpuvoKuH6enroC24oGg3VikC6pDbvabZvmlRUZLocQOjDaLxigh1qwMmM0zm1ntjrsvXz8pWCTLIFOjcxYRa/RfdC5SVDtyYuM9rxNG4Q=="}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:49:05.689053 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-850a20f4-90ea-4e16-9f25-82ee1231ee99 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Getting quotas for project 30bf0498eabd4d9988b2084c0b082fad. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:49:05.689053 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-850a20f4-90ea-4e16-9f25-82ee1231ee99 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Getting quotas for user 9767d18cf0944f16b45fff4214128c1a and project 30bf0498eabd4d9988b2084c0b082fad. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:49:06.177065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-850a20f4-90ea-4e16-9f25-82ee1231ee99 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.519831 Aug 22 12:49:06.186527 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 158/309] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 22 12:49:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:49:06.631381 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:06.635177 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:06.642440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:06.647805 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:06.648349 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:06.649072 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:06.649582 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:06.650015 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:06.807404 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:06.816661 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:06.818306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:06.819601 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7aa1f015-22d4-4489-ad5b-0480bc41281a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.192181 Aug 22 12:49:06.820247 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 152/310] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:06 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:07.843545 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:07.844817 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:07.851011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:07.851492 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:07.851923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:07.852616 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:07.853410 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:07.853908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:08.009019 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:08.019240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:08.024755 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:08.027786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-aa795414-1aa1-41be-8b3a-8f219b9b1d4d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.188107 Aug 22 12:49:08.028352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 159/311] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:07 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:09.010450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-834711425", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dfc2933b-45ff-4b52-8faf-55b30a6eda74"}], "security_groups": [{"name": "tempest-securitygroup--78423661"}], "key_name": "tempest-keypair-1984327608", "user_data": "}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:49:09.063491 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:09.064159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:09.079370 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:09.081347 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:09.081347 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:09.083785 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:09.084253 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:09.084684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:09.238174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.network.neutron [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] validate_networks() for [('dfc2933b-45ff-4b52-8faf-55b30a6eda74', None, None, None, None, None)] {{(pid=127810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:49:09.314279 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:09.326212 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:09.327806 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:09.328961 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-34598a9d-d1d8-4cd8-9d7c-12532adf2c44 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.281434 Aug 22 12:49:09.329501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 160/312] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:09 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:09.679133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Flavor limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:49:09.679649 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Image limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:49:09.680193 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Flavor pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:49:09.680677 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Image pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:49:09.681186 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:49:09.692438 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:09.692947 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:09.693394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:09.694141 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:09.699951 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:09.699951 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:09.713167 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Getting quotas for project 30bf0498eabd4d9988b2084c0b082fad. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:49:09.717752 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Getting quotas for user 9767d18cf0944f16b45fff4214128c1a and project 30bf0498eabd4d9988b2084c0b082fad. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:49:09.731308 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Going to run 1 instances... {{(pid=127810) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:49:09.733691 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:49:09.935465 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-5d8d5ab2-b2d0-4eed-a4fd-7a3aba670a37 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.929584 Aug 22 12:49:09.936034 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 153/313] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:49:09 2022] POST /compute/v2.1/servers => generated 407 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:49:09.947110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-aa998ec4-8773-4f15-93d5-10bc18296a09 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:09.954993 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-aa998ec4-8773-4f15-93d5-10bc18296a09 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:10.004340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-aa998ec4-8773-4f15-93d5-10bc18296a09 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:10.011131 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-aa998ec4-8773-4f15-93d5-10bc18296a09 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1245 microversion: 2.1 time: 0.067972 Aug 22 12:49:10.011798 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 161/314] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:09 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:10.353269 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:10.353879 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:10.361724 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:10.367487 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:10.367487 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:10.367487 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:10.367487 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:10.367849 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:10.529312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:10.538320 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:10.539989 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:10.541184 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ca6b71c3-33d4-46f4-8873-cf76032a3d21 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.192761 Aug 22 12:49:10.541746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 154/315] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:10 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:11.032498 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-88854f49-8933-41c3-8ae3-fe55c4f0cc4b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:11.033123 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-88854f49-8933-41c3-8ae3-fe55c4f0cc4b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:11.090698 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-88854f49-8933-41c3-8ae3-fe55c4f0cc4b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:11.101720 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-88854f49-8933-41c3-8ae3-fe55c4f0cc4b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1245 microversion: 2.1 time: 0.071407 Aug 22 12:49:11.101720 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 162/316] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:11 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:11.564066 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:11.564806 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:11.571431 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:11.571925 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:11.572367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:11.573083 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:11.573525 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:11.573952 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:11.712832 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:11.721703 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:11.723680 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:11.724402 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-44eba34f-5ba0-4968-b00d-85f40f42b1b0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.164262 Aug 22 12:49:11.724957 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 155/317] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:11 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:12.121631 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-48001dae-b97e-4479-a1b3-8744868f1cbf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:12.122383 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-48001dae-b97e-4479-a1b3-8744868f1cbf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:12.128308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48001dae-b97e-4479-a1b3-8744868f1cbf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:12.128789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48001dae-b97e-4479-a1b3-8744868f1cbf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:12.129222 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48001dae-b97e-4479-a1b3-8744868f1cbf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:12.130018 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48001dae-b97e-4479-a1b3-8744868f1cbf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:12.130749 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48001dae-b97e-4479-a1b3-8744868f1cbf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:12.131221 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48001dae-b97e-4479-a1b3-8744868f1cbf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:12.193606 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-48001dae-b97e-4479-a1b3-8744868f1cbf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:12.201689 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-48001dae-b97e-4479-a1b3-8744868f1cbf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1249 microversion: 2.1 time: 0.083950 Aug 22 12:49:12.206209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 163/318] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:12 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:12.748219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:12.748836 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:12.755528 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:12.756020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:12.756462 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:12.757161 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:12.757616 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:12.758053 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:12.892232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:12.900331 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:12.901844 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:12.903577 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-169c3f71-aa9e-4161-98a3-36a315ac16b4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.159252 Aug 22 12:49:12.904137 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 156/319] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:12 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:13.223167 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f3ae109b-d349-44c2-9e0f-b8533e24b6a5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:13.224043 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f3ae109b-d349-44c2-9e0f-b8533e24b6a5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:13.233910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3ae109b-d349-44c2-9e0f-b8533e24b6a5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:13.234375 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3ae109b-d349-44c2-9e0f-b8533e24b6a5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:13.234811 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3ae109b-d349-44c2-9e0f-b8533e24b6a5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:13.235512 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3ae109b-d349-44c2-9e0f-b8533e24b6a5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:13.235964 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3ae109b-d349-44c2-9e0f-b8533e24b6a5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:13.236385 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3ae109b-d349-44c2-9e0f-b8533e24b6a5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:13.313356 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f3ae109b-d349-44c2-9e0f-b8533e24b6a5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:13.322035 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f3ae109b-d349-44c2-9e0f-b8533e24b6a5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1249 microversion: 2.1 time: 0.103217 Aug 22 12:49:13.322584 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 164/320] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:13 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1249 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:13.926694 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:13.927248 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:13.933585 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:13.934115 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:13.934588 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:13.935282 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:13.935735 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:13.936160 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:14.066279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:14.075051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:14.076613 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:14.077779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-164a8638-eb56-4f03-b6ff-bcfdcdbac2ee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.155074 Aug 22 12:49:14.078354 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 157/321] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:13 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:14.343639 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-06b773a9-5f36-4f2f-80e6-e213602d6951 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:14.344248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-06b773a9-5f36-4f2f-80e6-e213602d6951 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:14.351231 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b773a9-5f36-4f2f-80e6-e213602d6951 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:14.351788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b773a9-5f36-4f2f-80e6-e213602d6951 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:14.352284 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b773a9-5f36-4f2f-80e6-e213602d6951 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:14.353311 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b773a9-5f36-4f2f-80e6-e213602d6951 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:14.353843 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b773a9-5f36-4f2f-80e6-e213602d6951 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:14.354200 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06b773a9-5f36-4f2f-80e6-e213602d6951 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:14.419039 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-06b773a9-5f36-4f2f-80e6-e213602d6951 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:14.430967 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-06b773a9-5f36-4f2f-80e6-e213602d6951 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1249 microversion: 2.1 time: 0.089709 Aug 22 12:49:14.430967 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 165/322] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:14 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:15.100743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:15.101345 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:15.107876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:15.108360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:15.108790 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:15.109477 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:15.109925 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:15.110376 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:15.265745 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:15.273993 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:15.275537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:15.276769 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1718f837-a7d4-4a95-8625-4e8ac4701ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1746 microversion: 2.20 time: 0.179818 Aug 22 12:49:15.277320 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 158/323] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:15 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1746 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:15.360648 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8a575074-88bf-4ee9-9ee8-6ab59fc56843 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:49:15.367119 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a575074-88bf-4ee9-9ee8-6ab59fc56843 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:15.367704 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a575074-88bf-4ee9-9ee8-6ab59fc56843 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:15.368215 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a575074-88bf-4ee9-9ee8-6ab59fc56843 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:15.429818 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8a575074-88bf-4ee9-9ee8-6ab59fc56843 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Going to try to stop instance {{(pid=127809) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 22 12:49:15.453079 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-584f0885-1ba2-4629-a5b2-b732270d938a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:15.453961 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-584f0885-1ba2-4629-a5b2-b732270d938a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:15.461551 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584f0885-1ba2-4629-a5b2-b732270d938a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:15.462197 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584f0885-1ba2-4629-a5b2-b732270d938a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:15.462734 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584f0885-1ba2-4629-a5b2-b732270d938a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:15.463504 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584f0885-1ba2-4629-a5b2-b732270d938a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:15.464030 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584f0885-1ba2-4629-a5b2-b732270d938a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:15.465192 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584f0885-1ba2-4629-a5b2-b732270d938a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:15.537761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-584f0885-1ba2-4629-a5b2-b732270d938a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:15.546946 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-584f0885-1ba2-4629-a5b2-b732270d938a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1305 microversion: 2.1 time: 0.099017 Aug 22 12:49:15.547531 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 159/324] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:15 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:49:15.712131 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8a575074-88bf-4ee9-9ee8-6ab59fc56843 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "POST /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/action" status: 202 len: 0 microversion: 2.1 time: 0.350953 Aug 22 12:49:15.712269 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 166/325] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 12:49:15 2022] POST /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:49:15.716894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-20c1e6e2-a4ad-4371-94ee-6eceb7e1c6c5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:15.717514 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-20c1e6e2-a4ad-4371-94ee-6eceb7e1c6c5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:15.734573 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20c1e6e2-a4ad-4371-94ee-6eceb7e1c6c5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:15.735371 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20c1e6e2-a4ad-4371-94ee-6eceb7e1c6c5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:15.735972 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20c1e6e2-a4ad-4371-94ee-6eceb7e1c6c5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:15.737224 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20c1e6e2-a4ad-4371-94ee-6eceb7e1c6c5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:15.737843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20c1e6e2-a4ad-4371-94ee-6eceb7e1c6c5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:15.738881 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20c1e6e2-a4ad-4371-94ee-6eceb7e1c6c5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:15.890828 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-20c1e6e2-a4ad-4371-94ee-6eceb7e1c6c5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:15.900825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-20c1e6e2-a4ad-4371-94ee-6eceb7e1c6c5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.187661 Aug 22 12:49:15.914207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 160/326] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:15 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:49:16.306137 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:16.306860 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:16.318536 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:16.318536 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:16.318536 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:16.318536 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:16.318849 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:16.318849 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:16.503467 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:16.512196 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:16.516248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:16.518565 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8da3ac27-4c4b-47d3-b5e2-9e5f27ada25b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1746 microversion: 2.20 time: 0.216429 Aug 22 12:49:16.528785 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 167/327] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:16 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1746 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:16.578706 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-60d17921-4944-4c89-8b47-c3561df385bb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:16.579512 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-60d17921-4944-4c89-8b47-c3561df385bb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:16.586217 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-60d17921-4944-4c89-8b47-c3561df385bb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:16.586876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-60d17921-4944-4c89-8b47-c3561df385bb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:16.587324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-60d17921-4944-4c89-8b47-c3561df385bb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:16.588035 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-60d17921-4944-4c89-8b47-c3561df385bb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:16.588499 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-60d17921-4944-4c89-8b47-c3561df385bb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:16.588923 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-60d17921-4944-4c89-8b47-c3561df385bb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:16.776964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-60d17921-4944-4c89-8b47-c3561df385bb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:16.784839 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-60d17921-4944-4c89-8b47-c3561df385bb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1369 microversion: 2.1 time: 0.212005 Aug 22 12:49:16.785391 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 161/328] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:16 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:16.927782 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-91cf2553-cdca-49dc-a4c4-7a1e752e04fa tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:16.928512 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-91cf2553-cdca-49dc-a4c4-7a1e752e04fa tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:16.935131 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-91cf2553-cdca-49dc-a4c4-7a1e752e04fa tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:16.935698 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-91cf2553-cdca-49dc-a4c4-7a1e752e04fa tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:16.936210 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-91cf2553-cdca-49dc-a4c4-7a1e752e04fa tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:16.936915 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-91cf2553-cdca-49dc-a4c4-7a1e752e04fa tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:16.937373 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-91cf2553-cdca-49dc-a4c4-7a1e752e04fa tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:16.937801 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-91cf2553-cdca-49dc-a4c4-7a1e752e04fa tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:16.957608 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:17.083992 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-91cf2553-cdca-49dc-a4c4-7a1e752e04fa tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:17.092160 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-91cf2553-cdca-49dc-a4c4-7a1e752e04fa tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.168339 Aug 22 12:49:17.092736 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 168/329] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:16 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:17.499139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-3d938aa8-c169-462a-83a8-e02f598aa3c3 req-2c8ec57a-f1b3-4726-a9e2-c4d296a8d350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e67844-4079-4ba2-8edd-5c5023f9d4d4", "tag": "613e8f21-6d47-446a-84a6-33a7a6307506"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:49:17.508937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-3d938aa8-c169-462a-83a8-e02f598aa3c3 req-2c8ec57a-f1b3-4726-a9e2-c4d296a8d350 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:17.509427 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-3d938aa8-c169-462a-83a8-e02f598aa3c3 req-2c8ec57a-f1b3-4726-a9e2-c4d296a8d350 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:17.509858 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-3d938aa8-c169-462a-83a8-e02f598aa3c3 req-2c8ec57a-f1b3-4726-a9e2-c4d296a8d350 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:17.521468 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-3d938aa8-c169-462a-83a8-e02f598aa3c3 req-2c8ec57a-f1b3-4726-a9e2-c4d296a8d350 service nova] Creating event network-changed:613e8f21-6d47-446a-84a6-33a7a6307506 for instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 on hv-cinder-85083 Aug 22 12:49:17.526728 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-3d938aa8-c169-462a-83a8-e02f598aa3c3 req-2c8ec57a-f1b3-4726-a9e2-c4d296a8d350 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031881 Aug 22 12:49:17.527669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 162/330] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:49:17.541322 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:17.542087 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:17.551441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:17.551441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:17.551441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:17.551441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:17.551819 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:17.551819 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:17.698004 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:17.707876 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:17.708174 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:17.709811 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-92c9d872-3e1b-438d-abd6-06752c20c746 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1746 microversion: 2.20 time: 0.172897 Aug 22 12:49:17.711192 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 169/331] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:17 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:17.810997 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-5c6c7123-6410-42f2-9a00-2697185ee653 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:17.812446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-5c6c7123-6410-42f2-9a00-2697185ee653 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:17.824453 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5c6c7123-6410-42f2-9a00-2697185ee653 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:17.826108 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5c6c7123-6410-42f2-9a00-2697185ee653 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:17.829351 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5c6c7123-6410-42f2-9a00-2697185ee653 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:17.830411 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5c6c7123-6410-42f2-9a00-2697185ee653 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:17.832859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5c6c7123-6410-42f2-9a00-2697185ee653 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:17.833557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5c6c7123-6410-42f2-9a00-2697185ee653 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:18.055975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-5c6c7123-6410-42f2-9a00-2697185ee653 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:18.064573 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-5c6c7123-6410-42f2-9a00-2697185ee653 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1369 microversion: 2.1 time: 0.259606 Aug 22 12:49:18.080810 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 163/332] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:17 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1369 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:18.117977 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-366a6972-49bf-4262-941b-a5c9101bff74 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:18.118689 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-366a6972-49bf-4262-941b-a5c9101bff74 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:18.125917 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-366a6972-49bf-4262-941b-a5c9101bff74 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:18.126525 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-366a6972-49bf-4262-941b-a5c9101bff74 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:18.126968 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-366a6972-49bf-4262-941b-a5c9101bff74 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:18.127671 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-366a6972-49bf-4262-941b-a5c9101bff74 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:18.128139 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-366a6972-49bf-4262-941b-a5c9101bff74 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:18.128563 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-366a6972-49bf-4262-941b-a5c9101bff74 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:18.472299 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-366a6972-49bf-4262-941b-a5c9101bff74 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:18.481556 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-366a6972-49bf-4262-941b-a5c9101bff74 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.371186 Aug 22 12:49:18.482447 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 170/333] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:18 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:18.735511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:18.736368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:18.743386 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:18.743882 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:18.744321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:18.745127 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:18.746373 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:18.746811 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:18.941226 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:18.951103 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:18.952619 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:18.953853 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-99bb1fa7-e468-45fc-87ed-989260da1caa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.222670 Aug 22 12:49:18.954812 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 164/334] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:18 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:19.087057 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a153e9be-8f96-4681-9c11-47988bfed617 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:19.087817 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a153e9be-8f96-4681-9c11-47988bfed617 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:19.093914 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a153e9be-8f96-4681-9c11-47988bfed617 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:19.094472 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a153e9be-8f96-4681-9c11-47988bfed617 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:19.094911 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a153e9be-8f96-4681-9c11-47988bfed617 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:19.095609 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a153e9be-8f96-4681-9c11-47988bfed617 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:19.096269 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a153e9be-8f96-4681-9c11-47988bfed617 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:19.096701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a153e9be-8f96-4681-9c11-47988bfed617 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:19.327868 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a153e9be-8f96-4681-9c11-47988bfed617 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:19.349242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a153e9be-8f96-4681-9c11-47988bfed617 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1369 microversion: 2.1 time: 0.267394 Aug 22 12:49:19.355460 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 171/335] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:19 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1369 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:19.507290 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-42f14194-b91e-4498-b5bc-73b2a5af64a4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:19.508301 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-42f14194-b91e-4498-b5bc-73b2a5af64a4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:19.545938 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42f14194-b91e-4498-b5bc-73b2a5af64a4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:19.547599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42f14194-b91e-4498-b5bc-73b2a5af64a4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:19.548264 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42f14194-b91e-4498-b5bc-73b2a5af64a4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:19.548999 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42f14194-b91e-4498-b5bc-73b2a5af64a4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:19.550959 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42f14194-b91e-4498-b5bc-73b2a5af64a4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:19.554502 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42f14194-b91e-4498-b5bc-73b2a5af64a4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:19.600172 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-0914a7fc-6cd0-409b-a794-6bcb601583d0 req-3adc0aba-7559-4b12-ac60-37135e744dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e060778-7e35-44e9-99f4-f2fb64f07928", "name": "network-vif-plugged", "status": "completed", "tag": "b8fb88da-a096-4c45-bd62-6606ee956319"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:49:19.641906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-0914a7fc-6cd0-409b-a794-6bcb601583d0 req-3adc0aba-7559-4b12-ac60-37135e744dd3 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:19.643508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-0914a7fc-6cd0-409b-a794-6bcb601583d0 req-3adc0aba-7559-4b12-ac60-37135e744dd3 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:19.647416 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-0914a7fc-6cd0-409b-a794-6bcb601583d0 req-3adc0aba-7559-4b12-ac60-37135e744dd3 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:19.688656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-0914a7fc-6cd0-409b-a794-6bcb601583d0 req-3adc0aba-7559-4b12-ac60-37135e744dd3 service nova] Creating event network-vif-plugged:b8fb88da-a096-4c45-bd62-6606ee956319 for instance 4e060778-7e35-44e9-99f4-f2fb64f07928 on hv-cinder-85083 Aug 22 12:49:19.701340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-0914a7fc-6cd0-409b-a794-6bcb601583d0 req-3adc0aba-7559-4b12-ac60-37135e744dd3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106000 Aug 22 12:49:19.703502 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 172/336] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:49:19.704770 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:19.725440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=6 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:19.923938 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-42f14194-b91e-4498-b5bc-73b2a5af64a4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:19.947462 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-42f14194-b91e-4498-b5bc-73b2a5af64a4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.444673 Aug 22 12:49:19.949656 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 165/337] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:19 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:19.978491 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:19.979489 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:19.986409 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:19.986904 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:19.987339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:19.988067 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:19.988690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:19.989115 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:20.146920 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:20.159794 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:20.161297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:20.162481 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b9490f97-d869-48f2-ac43-6dafa8be993d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.189373 Aug 22 12:49:20.174878 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 173/338] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:19 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:20.378597 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1344b921-847e-4e83-9046-1aad701a5574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:20.380822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1344b921-847e-4e83-9046-1aad701a5574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:20.388867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1344b921-847e-4e83-9046-1aad701a5574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:20.389603 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1344b921-847e-4e83-9046-1aad701a5574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:20.390213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1344b921-847e-4e83-9046-1aad701a5574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:20.391189 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1344b921-847e-4e83-9046-1aad701a5574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:20.391790 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1344b921-847e-4e83-9046-1aad701a5574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:20.392362 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1344b921-847e-4e83-9046-1aad701a5574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:20.539238 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1344b921-847e-4e83-9046-1aad701a5574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:20.543160 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:20.548017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1344b921-847e-4e83-9046-1aad701a5574 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1369 microversion: 2.1 time: 0.175485 Aug 22 12:49:20.563202 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 166/339] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:20 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:20.970172 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7f1ef8b1-3b03-4404-9d8a-57212f6da029 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:20.971056 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7f1ef8b1-3b03-4404-9d8a-57212f6da029 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:20.977458 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7f1ef8b1-3b03-4404-9d8a-57212f6da029 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:20.978436 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7f1ef8b1-3b03-4404-9d8a-57212f6da029 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:20.979049 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7f1ef8b1-3b03-4404-9d8a-57212f6da029 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:20.980456 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7f1ef8b1-3b03-4404-9d8a-57212f6da029 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:20.981058 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7f1ef8b1-3b03-4404-9d8a-57212f6da029 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:20.981633 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7f1ef8b1-3b03-4404-9d8a-57212f6da029 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:21.095532 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=8 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:21.152829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7f1ef8b1-3b03-4404-9d8a-57212f6da029 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:21.177084 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7f1ef8b1-3b03-4404-9d8a-57212f6da029 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.209967 Aug 22 12:49:21.209375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:21.232219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:21.232219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:21.232219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:21.232219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:21.233240 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:21.233240 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:21.233240 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:21.233599 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 174/340] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:20 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:21.478829 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:21.502344 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:21.502344 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:21.502344 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-962a8da1-b3e8-4b1a-b3a8-f6fbbf6c9f26 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.292678 Aug 22 12:49:21.502700 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 167/341] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:21 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:21.570673 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b1bacf26-181d-484b-904c-0f8ea35b2e54 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:21.571696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b1bacf26-181d-484b-904c-0f8ea35b2e54 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:21.579629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1bacf26-181d-484b-904c-0f8ea35b2e54 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:21.580570 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1bacf26-181d-484b-904c-0f8ea35b2e54 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:21.581192 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1bacf26-181d-484b-904c-0f8ea35b2e54 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:21.581905 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1bacf26-181d-484b-904c-0f8ea35b2e54 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:21.582395 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1bacf26-181d-484b-904c-0f8ea35b2e54 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:21.583010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1bacf26-181d-484b-904c-0f8ea35b2e54 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:21.746728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b1bacf26-181d-484b-904c-0f8ea35b2e54 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:21.756145 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b1bacf26-181d-484b-904c-0f8ea35b2e54 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1369 microversion: 2.1 time: 0.190214 Aug 22 12:49:21.756962 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 175/342] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:21 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1369 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:22.220876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c92ef58c-3758-47a2-9a2a-f789f16d8c87 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:22.221800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c92ef58c-3758-47a2-9a2a-f789f16d8c87 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:22.229957 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c92ef58c-3758-47a2-9a2a-f789f16d8c87 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:22.230627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c92ef58c-3758-47a2-9a2a-f789f16d8c87 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:22.231159 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c92ef58c-3758-47a2-9a2a-f789f16d8c87 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:22.231945 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c92ef58c-3758-47a2-9a2a-f789f16d8c87 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:22.232486 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c92ef58c-3758-47a2-9a2a-f789f16d8c87 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:22.232982 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c92ef58c-3758-47a2-9a2a-f789f16d8c87 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:22.393517 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c92ef58c-3758-47a2-9a2a-f789f16d8c87 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:22.404370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c92ef58c-3758-47a2-9a2a-f789f16d8c87 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.187204 Aug 22 12:49:22.405476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 168/343] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:22 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:22.523836 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:22.524407 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:22.531070 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:22.531556 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:22.531992 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:22.532684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:22.533141 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:22.533622 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:22.666579 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:22.674169 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:22.675691 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:22.676836 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d79f113b-c8bb-4d25-80db-8b1c4a7ee364 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.157591 Aug 22 12:49:22.677382 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 176/344] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:22 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:22.777298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b887bca0-fe30-4421-aaf3-48c3327bcdc8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:22.778256 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b887bca0-fe30-4421-aaf3-48c3327bcdc8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:22.784726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b887bca0-fe30-4421-aaf3-48c3327bcdc8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:22.785213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b887bca0-fe30-4421-aaf3-48c3327bcdc8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:22.785647 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b887bca0-fe30-4421-aaf3-48c3327bcdc8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:22.786393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b887bca0-fe30-4421-aaf3-48c3327bcdc8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:22.786832 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b887bca0-fe30-4421-aaf3-48c3327bcdc8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:22.787255 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b887bca0-fe30-4421-aaf3-48c3327bcdc8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:22.930120 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b887bca0-fe30-4421-aaf3-48c3327bcdc8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:22.938835 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b887bca0-fe30-4421-aaf3-48c3327bcdc8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1369 microversion: 2.1 time: 0.165609 Aug 22 12:49:22.939443 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 169/345] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:22 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:23.426610 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8e5e143b-8d3d-49a5-a28b-fd1ae3dbb7b2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:23.429396 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8e5e143b-8d3d-49a5-a28b-fd1ae3dbb7b2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:23.439377 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e5e143b-8d3d-49a5-a28b-fd1ae3dbb7b2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:23.440083 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e5e143b-8d3d-49a5-a28b-fd1ae3dbb7b2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:23.440875 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e5e143b-8d3d-49a5-a28b-fd1ae3dbb7b2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:23.441700 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e5e143b-8d3d-49a5-a28b-fd1ae3dbb7b2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:23.442418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e5e143b-8d3d-49a5-a28b-fd1ae3dbb7b2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:23.443068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e5e143b-8d3d-49a5-a28b-fd1ae3dbb7b2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:23.484520 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-41bd909d-3c77-4057-9229-8981ef027274 req-751017ac-9da1-4370-b2ea-c0eda5e2f02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e67844-4079-4ba2-8edd-5c5023f9d4d4", "name": "network-vif-plugged", "status": "completed", "tag": "613e8f21-6d47-446a-84a6-33a7a6307506"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:49:23.506127 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-41bd909d-3c77-4057-9229-8981ef027274 req-751017ac-9da1-4370-b2ea-c0eda5e2f02c service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:23.506852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-41bd909d-3c77-4057-9229-8981ef027274 req-751017ac-9da1-4370-b2ea-c0eda5e2f02c service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:23.507364 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-41bd909d-3c77-4057-9229-8981ef027274 req-751017ac-9da1-4370-b2ea-c0eda5e2f02c service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:23.520764 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-41bd909d-3c77-4057-9229-8981ef027274 req-751017ac-9da1-4370-b2ea-c0eda5e2f02c service nova] Creating event network-vif-plugged:613e8f21-6d47-446a-84a6-33a7a6307506 for instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 on hv-cinder-85083 Aug 22 12:49:23.526885 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-41bd909d-3c77-4057-9229-8981ef027274 req-751017ac-9da1-4370-b2ea-c0eda5e2f02c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046688 Aug 22 12:49:23.531606 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 170/346] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:49:23.644971 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8e5e143b-8d3d-49a5-a28b-fd1ae3dbb7b2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:23.666144 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8e5e143b-8d3d-49a5-a28b-fd1ae3dbb7b2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.243902 Aug 22 12:49:23.667724 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 177/347] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:23 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:23.702324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:23.703303 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:23.710585 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:23.711697 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:23.713341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:23.713341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:23.713341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:23.713770 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:23.921192 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:23.932355 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:23.934112 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:23.935386 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-da069dd1-2b03-470d-9826-7c7d09242c7e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.238408 Aug 22 12:49:23.935956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 171/348] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:23 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:23.960390 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2ebe8c2e-3fd0-423c-ae43-b0a84c34c3b7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:23.961015 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2ebe8c2e-3fd0-423c-ae43-b0a84c34c3b7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:23.981889 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2ebe8c2e-3fd0-423c-ae43-b0a84c34c3b7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:23.982740 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2ebe8c2e-3fd0-423c-ae43-b0a84c34c3b7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:23.983605 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2ebe8c2e-3fd0-423c-ae43-b0a84c34c3b7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:23.984565 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2ebe8c2e-3fd0-423c-ae43-b0a84c34c3b7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:23.985215 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2ebe8c2e-3fd0-423c-ae43-b0a84c34c3b7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:23.985676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2ebe8c2e-3fd0-423c-ae43-b0a84c34c3b7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:24.203838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2ebe8c2e-3fd0-423c-ae43-b0a84c34c3b7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:24.212235 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2ebe8c2e-3fd0-423c-ae43-b0a84c34c3b7 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1369 microversion: 2.1 time: 0.255790 Aug 22 12:49:24.213463 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 178/349] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:23 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1369 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:24.691323 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-9815dc02-cc49-41db-9fc9-d98d96b646fc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:24.692920 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-9815dc02-cc49-41db-9fc9-d98d96b646fc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:24.703702 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9815dc02-cc49-41db-9fc9-d98d96b646fc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:24.704557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9815dc02-cc49-41db-9fc9-d98d96b646fc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:24.705277 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9815dc02-cc49-41db-9fc9-d98d96b646fc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:24.706684 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9815dc02-cc49-41db-9fc9-d98d96b646fc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:24.707464 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9815dc02-cc49-41db-9fc9-d98d96b646fc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:24.708412 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9815dc02-cc49-41db-9fc9-d98d96b646fc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:24.880753 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9815dc02-cc49-41db-9fc9-d98d96b646fc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:24.889679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-9815dc02-cc49-41db-9fc9-d98d96b646fc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.204852 Aug 22 12:49:24.890293 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 172/350] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:24 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:24.964527 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:24.965147 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:24.990885 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:24.996839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:24.997305 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:25.002098 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:25.002098 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:25.002098 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:25.163995 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:25.172662 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:25.185505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:25.187240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-19a0ad3c-3d6d-4dc3-abd6-a0e2d2850de8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.227114 Aug 22 12:49:25.187873 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 179/351] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:24 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:25.234613 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0e4327a6-8fd1-4b81-b9d5-99a0901428e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:25.235521 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0e4327a6-8fd1-4b81-b9d5-99a0901428e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:25.262330 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e4327a6-8fd1-4b81-b9d5-99a0901428e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:25.262330 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e4327a6-8fd1-4b81-b9d5-99a0901428e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:25.262330 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e4327a6-8fd1-4b81-b9d5-99a0901428e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:25.262330 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e4327a6-8fd1-4b81-b9d5-99a0901428e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:25.262945 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e4327a6-8fd1-4b81-b9d5-99a0901428e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:25.262945 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e4327a6-8fd1-4b81-b9d5-99a0901428e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:25.420637 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0e4327a6-8fd1-4b81-b9d5-99a0901428e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:25.429824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0e4327a6-8fd1-4b81-b9d5-99a0901428e8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1369 microversion: 2.1 time: 0.199029 Aug 22 12:49:25.431112 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 173/352] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:25 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1369 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:25.911752 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-4bf884bc-8197-44ea-8e9d-101b6611185c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:25.912394 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-4bf884bc-8197-44ea-8e9d-101b6611185c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:25.914311 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:25.919611 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bf884bc-8197-44ea-8e9d-101b6611185c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:25.920090 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bf884bc-8197-44ea-8e9d-101b6611185c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:25.920521 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bf884bc-8197-44ea-8e9d-101b6611185c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:25.921203 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bf884bc-8197-44ea-8e9d-101b6611185c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:25.921656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bf884bc-8197-44ea-8e9d-101b6611185c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:25.922076 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bf884bc-8197-44ea-8e9d-101b6611185c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:26.059405 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4bf884bc-8197-44ea-8e9d-101b6611185c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:26.067638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-4bf884bc-8197-44ea-8e9d-101b6611185c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.159830 Aug 22 12:49:26.068194 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 180/353] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:25 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:26.209630 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:26.210202 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:26.216565 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:26.217058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:26.217500 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:26.218204 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:26.218669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:26.219095 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:26.361601 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:26.369643 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:26.371707 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:26.373078 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1646b162-992a-4834-8414-a189fb25bb75 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.167584 Aug 22 12:49:26.373627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 174/354] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:26 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:26.451800 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2f57d278-5b5b-40ac-9a83-c242a3aee22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:26.452644 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2f57d278-5b5b-40ac-9a83-c242a3aee22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:26.458756 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2f57d278-5b5b-40ac-9a83-c242a3aee22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:26.459247 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2f57d278-5b5b-40ac-9a83-c242a3aee22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:26.459739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2f57d278-5b5b-40ac-9a83-c242a3aee22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:26.460385 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2f57d278-5b5b-40ac-9a83-c242a3aee22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:26.460844 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2f57d278-5b5b-40ac-9a83-c242a3aee22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:26.461276 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2f57d278-5b5b-40ac-9a83-c242a3aee22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:26.597403 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2f57d278-5b5b-40ac-9a83-c242a3aee22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:26.605891 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2f57d278-5b5b-40ac-9a83-c242a3aee22f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1563 microversion: 2.1 time: 0.158047 Aug 22 12:49:26.606499 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 181/355] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:26 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:26.626443 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-fcd80e96-a2c7-4778-9a1a-77f7def285db tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:26.631918 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-fcd80e96-a2c7-4778-9a1a-77f7def285db tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:26.633593 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fcd80e96-a2c7-4778-9a1a-77f7def285db tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:26.634156 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fcd80e96-a2c7-4778-9a1a-77f7def285db tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:26.634619 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fcd80e96-a2c7-4778-9a1a-77f7def285db tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:26.635515 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fcd80e96-a2c7-4778-9a1a-77f7def285db tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:26.636470 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fcd80e96-a2c7-4778-9a1a-77f7def285db tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:26.636895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fcd80e96-a2c7-4778-9a1a-77f7def285db tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:26.724742 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-fcd80e96-a2c7-4778-9a1a-77f7def285db tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102014 Aug 22 12:49:26.725707 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 175/356] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 22 12:49:26 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:49:27.089035 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-28ace597-938e-442d-9e72-50c749894003 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:27.092437 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-28ace597-938e-442d-9e72-50c749894003 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:27.099906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28ace597-938e-442d-9e72-50c749894003 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:27.100434 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28ace597-938e-442d-9e72-50c749894003 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:27.100951 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28ace597-938e-442d-9e72-50c749894003 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:27.101741 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28ace597-938e-442d-9e72-50c749894003 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:27.102315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28ace597-938e-442d-9e72-50c749894003 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:27.103074 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28ace597-938e-442d-9e72-50c749894003 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:27.398833 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:27.400667 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:27.415036 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:27.415938 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:27.417782 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:27.419858 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:27.421061 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:27.421704 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:27.737605 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-28ace597-938e-442d-9e72-50c749894003 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:27.747221 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-28ace597-938e-442d-9e72-50c749894003 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.662360 Aug 22 12:49:27.748034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 182/357] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:27 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:27.820611 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:27.835605 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:27.837115 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:27.838324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-cdaaefd4-845a-47ae-a009-b595b5fd4106 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.445422 Aug 22 12:49:27.850995 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 176/358] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:27 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:28.556889 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-8906fb22-021f-4466-a653-22f9e52eb41f req-0deac6aa-5e50-4547-a8ff-fbb0253bc973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e67844-4079-4ba2-8edd-5c5023f9d4d4", "tag": "613e8f21-6d47-446a-84a6-33a7a6307506"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:49:28.582067 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-8906fb22-021f-4466-a653-22f9e52eb41f req-0deac6aa-5e50-4547-a8ff-fbb0253bc973 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:28.582598 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-8906fb22-021f-4466-a653-22f9e52eb41f req-0deac6aa-5e50-4547-a8ff-fbb0253bc973 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:28.583042 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-8906fb22-021f-4466-a653-22f9e52eb41f req-0deac6aa-5e50-4547-a8ff-fbb0253bc973 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:28.628494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-8906fb22-021f-4466-a653-22f9e52eb41f req-0deac6aa-5e50-4547-a8ff-fbb0253bc973 service nova] Creating event network-changed:613e8f21-6d47-446a-84a6-33a7a6307506 for instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 on hv-cinder-85083 Aug 22 12:49:28.641480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-8906fb22-021f-4466-a653-22f9e52eb41f req-0deac6aa-5e50-4547-a8ff-fbb0253bc973 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088319 Aug 22 12:49:28.648055 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 183/359] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:49:28.771131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-93684313-56fa-411f-af31-0fb64b86fcf6 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:28.772541 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-93684313-56fa-411f-af31-0fb64b86fcf6 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:28.786630 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-93684313-56fa-411f-af31-0fb64b86fcf6 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:28.788141 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-93684313-56fa-411f-af31-0fb64b86fcf6 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:28.788604 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-93684313-56fa-411f-af31-0fb64b86fcf6 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:28.789577 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-93684313-56fa-411f-af31-0fb64b86fcf6 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:28.790400 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-93684313-56fa-411f-af31-0fb64b86fcf6 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:28.791051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-93684313-56fa-411f-af31-0fb64b86fcf6 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:28.866008 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:28.869630 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:28.876883 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:28.877394 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:28.877840 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:28.878651 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:28.879055 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:28.879490 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:29.033201 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-93684313-56fa-411f-af31-0fb64b86fcf6 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:29.052072 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-93684313-56fa-411f-af31-0fb64b86fcf6 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.286270 Aug 22 12:49:29.066525 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 177/360] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:28 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:29.159290 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:29.179994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:29.184803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:29.188598 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-866420a7-bd8d-4d2b-9c6c-e84a163d7366 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.325635 Aug 22 12:49:29.189250 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 184/361] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:28 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:30.073901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-516ff766-7996-4c10-8a99-909d42f53cb2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:30.075104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-516ff766-7996-4c10-8a99-909d42f53cb2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:30.089428 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-516ff766-7996-4c10-8a99-909d42f53cb2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:30.093820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-516ff766-7996-4c10-8a99-909d42f53cb2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:30.094341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-516ff766-7996-4c10-8a99-909d42f53cb2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:30.095111 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-516ff766-7996-4c10-8a99-909d42f53cb2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:30.095577 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-516ff766-7996-4c10-8a99-909d42f53cb2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:30.096019 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-516ff766-7996-4c10-8a99-909d42f53cb2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:30.214639 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:30.215997 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:30.230516 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:30.231316 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:30.232000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:30.232902 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:30.233547 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:30.234132 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:30.347695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-516ff766-7996-4c10-8a99-909d42f53cb2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:30.357620 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-516ff766-7996-4c10-8a99-909d42f53cb2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.288543 Aug 22 12:49:30.358867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 178/362] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:30 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:30.458690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:30.468894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:30.472284 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:30.473981 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-14d28466-2769-4c14-bb9f-4500190b1ac7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.263731 Aug 22 12:49:30.480572 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 185/363] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:30 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:31.379629 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-db522a82-2723-49f3-994e-1c3c71f9492c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:31.380338 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-db522a82-2723-49f3-994e-1c3c71f9492c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:31.387359 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db522a82-2723-49f3-994e-1c3c71f9492c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:31.387842 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db522a82-2723-49f3-994e-1c3c71f9492c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:31.388283 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db522a82-2723-49f3-994e-1c3c71f9492c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:31.388971 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db522a82-2723-49f3-994e-1c3c71f9492c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:31.389424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db522a82-2723-49f3-994e-1c3c71f9492c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:31.389847 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-db522a82-2723-49f3-994e-1c3c71f9492c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:31.504894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:31.506343 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:31.518746 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:31.520677 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:31.521683 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:31.522930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:31.523608 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:31.530729 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:31.552397 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=100 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:31.560139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-db522a82-2723-49f3-994e-1c3c71f9492c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:31.571524 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-db522a82-2723-49f3-994e-1c3c71f9492c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.195760 Aug 22 12:49:31.572107 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 179/364] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:31 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:31.697457 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:31.708459 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:31.711303 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:31.712040 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b7d1c5a5-71cc-4d6b-8ff9-842123550265 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.211063 Aug 22 12:49:31.723499 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 186/365] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:31 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:32.596196 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a0171349-3877-4d9d-ac04-b5b768e3eeca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:32.596810 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a0171349-3877-4d9d-ac04-b5b768e3eeca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:32.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a0171349-3877-4d9d-ac04-b5b768e3eeca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:32.609727 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a0171349-3877-4d9d-ac04-b5b768e3eeca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:32.609727 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a0171349-3877-4d9d-ac04-b5b768e3eeca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:32.609727 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a0171349-3877-4d9d-ac04-b5b768e3eeca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:32.609727 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a0171349-3877-4d9d-ac04-b5b768e3eeca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:32.610081 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a0171349-3877-4d9d-ac04-b5b768e3eeca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:32.736983 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:32.737613 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:32.744442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:32.745434 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:32.747711 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a0171349-3877-4d9d-ac04-b5b768e3eeca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:32.748526 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:32.749245 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:32.749705 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:32.750133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:32.758423 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a0171349-3877-4d9d-ac04-b5b768e3eeca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.166863 Aug 22 12:49:32.759575 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 180/366] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:32 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:32.909520 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:32.917933 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:32.919457 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:32.920607 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0709d480-347e-45eb-83e2-b8ce60d8c873 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1741 microversion: 2.20 time: 0.187683 Aug 22 12:49:32.921152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 187/367] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:32 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:33.785614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-647b239d-4dba-4b5f-ba57-27f4252eb5fe tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:33.785614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-647b239d-4dba-4b5f-ba57-27f4252eb5fe tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:33.794541 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-647b239d-4dba-4b5f-ba57-27f4252eb5fe tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:33.795246 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-647b239d-4dba-4b5f-ba57-27f4252eb5fe tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:33.795856 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-647b239d-4dba-4b5f-ba57-27f4252eb5fe tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:33.796749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-647b239d-4dba-4b5f-ba57-27f4252eb5fe tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:33.797205 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-647b239d-4dba-4b5f-ba57-27f4252eb5fe tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:33.797627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-647b239d-4dba-4b5f-ba57-27f4252eb5fe tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:33.945174 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:33.945795 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:33.953253 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:33.953746 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:33.954246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:33.954909 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:33.955368 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:33.955787 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:33.961004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-647b239d-4dba-4b5f-ba57-27f4252eb5fe tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:33.974275 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-647b239d-4dba-4b5f-ba57-27f4252eb5fe tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.196827 Aug 22 12:49:33.975358 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 181/368] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:33 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:34.121687 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:34.130498 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:34.132162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:34.133332 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-3460af3a-ed2b-4369-a00a-1efc665f3503 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1723 microversion: 2.20 time: 0.192175 Aug 22 12:49:34.133930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 188/369] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:33 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:34.997773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7db67f02-00d2-456d-a276-13ffbee6ee86 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:34.998440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7db67f02-00d2-456d-a276-13ffbee6ee86 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:35.004968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7db67f02-00d2-456d-a276-13ffbee6ee86 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:35.006658 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7db67f02-00d2-456d-a276-13ffbee6ee86 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:35.006658 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7db67f02-00d2-456d-a276-13ffbee6ee86 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:35.006658 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7db67f02-00d2-456d-a276-13ffbee6ee86 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:35.007008 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7db67f02-00d2-456d-a276-13ffbee6ee86 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:35.007425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7db67f02-00d2-456d-a276-13ffbee6ee86 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:35.137880 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7db67f02-00d2-456d-a276-13ffbee6ee86 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:35.146461 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7db67f02-00d2-456d-a276-13ffbee6ee86 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.152890 Aug 22 12:49:35.147039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 182/370] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:34 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:35.158099 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:35.159282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:35.165145 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:35.165636 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:35.166076 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:35.166833 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:35.167292 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:35.167718 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:35.311927 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:35.320340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:35.321849 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:35.323575 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-198a92ac-a08e-4832-8cf3-2dd25b26060f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1723 microversion: 2.20 time: 0.169565 Aug 22 12:49:35.324129 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 189/371] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:35 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:36.169440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-897c50a4-3173-45c4-961a-5c6839132ec3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:36.170058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-897c50a4-3173-45c4-961a-5c6839132ec3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:36.176391 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-897c50a4-3173-45c4-961a-5c6839132ec3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:36.176890 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-897c50a4-3173-45c4-961a-5c6839132ec3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:36.177330 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-897c50a4-3173-45c4-961a-5c6839132ec3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:36.178026 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-897c50a4-3173-45c4-961a-5c6839132ec3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:36.178601 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-897c50a4-3173-45c4-961a-5c6839132ec3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:36.179037 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-897c50a4-3173-45c4-961a-5c6839132ec3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:36.315502 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-897c50a4-3173-45c4-961a-5c6839132ec3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:36.324853 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-897c50a4-3173-45c4-961a-5c6839132ec3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.159807 Aug 22 12:49:36.326312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 183/372] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:36 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:36.347594 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:36.348328 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:36.354671 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:36.355190 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:36.355612 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:36.356316 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:36.356780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:36.357210 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:36.491517 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:36.499686 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:36.501193 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:36.502390 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-90c19584-95fc-4c67-bca1-339295d6429e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1723 microversion: 2.20 time: 0.158725 Aug 22 12:49:36.502956 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 190/373] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:36 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:37.349851 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7b955408-9092-4ddc-9115-3148465f58ba tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:37.350591 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7b955408-9092-4ddc-9115-3148465f58ba tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:37.353749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:37.359129 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b955408-9092-4ddc-9115-3148465f58ba tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:37.359898 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b955408-9092-4ddc-9115-3148465f58ba tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:37.360364 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b955408-9092-4ddc-9115-3148465f58ba tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:37.361273 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b955408-9092-4ddc-9115-3148465f58ba tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:37.361768 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b955408-9092-4ddc-9115-3148465f58ba tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:37.362300 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7b955408-9092-4ddc-9115-3148465f58ba tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:37.383377 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=100 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:37.525152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:37.532128 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:37.551966 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7b955408-9092-4ddc-9115-3148465f58ba tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:37.552080 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:37.552080 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:37.552080 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:37.554276 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:37.554966 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:37.556370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7b955408-9092-4ddc-9115-3148465f58ba tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.214199 Aug 22 12:49:37.556515 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:37.557896 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 184/374] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:37 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:37.580693 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-c6bf4cde-562a-40aa-8044-430b33838a35 req-c49493e8-1826-4dec-b333-b844be7feaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e060778-7e35-44e9-99f4-f2fb64f07928", "name": "network-vif-unplugged", "status": "completed", "tag": "b8fb88da-a096-4c45-bd62-6606ee956319"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:49:37.592048 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c6bf4cde-562a-40aa-8044-430b33838a35 req-c49493e8-1826-4dec-b333-b844be7feaea service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:37.592539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c6bf4cde-562a-40aa-8044-430b33838a35 req-c49493e8-1826-4dec-b333-b844be7feaea service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:37.593126 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c6bf4cde-562a-40aa-8044-430b33838a35 req-c49493e8-1826-4dec-b333-b844be7feaea service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:37.612852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.compute.server_external_events [req-c6bf4cde-562a-40aa-8044-430b33838a35 req-c49493e8-1826-4dec-b333-b844be7feaea service nova] Unable to find a host for instance 4e060778-7e35-44e9-99f4-f2fb64f07928. Dropping event network-vif-unplugged {{(pid=127810) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 22 12:49:37.614288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-c6bf4cde-562a-40aa-8044-430b33838a35 req-c49493e8-1826-4dec-b333-b844be7feaea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038531 Aug 22 12:49:37.614903 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 185/375] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 22 12:49:37.750643 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:37.760098 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:37.762789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:37.763975 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6ab4f93f-713d-45ab-a865-3b34244ffc5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1666 microversion: 2.20 time: 0.242729 Aug 22 12:49:37.764532 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 191/376] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:37 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1666 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:37.786627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d712aba2-0ee8-4282-86a8-35385881c8d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c5b44a4-eedb-44e1-807c-fbe04e2075e4"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:49:37.789049 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d712aba2-0ee8-4282-86a8-35385881c8d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:37.795195 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d712aba2-0ee8-4282-86a8-35385881c8d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:37.795724 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d712aba2-0ee8-4282-86a8-35385881c8d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:37.796111 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d712aba2-0ee8-4282-86a8-35385881c8d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:37.796808 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d712aba2-0ee8-4282-86a8-35385881c8d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:37.797260 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d712aba2-0ee8-4282-86a8-35385881c8d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:37.797683 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d712aba2-0ee8-4282-86a8-35385881c8d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:38.580226 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9cb9db2b-302e-460b-8154-5c1593a7c520 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:38.583618 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9cb9db2b-302e-460b-8154-5c1593a7c520 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:38.586793 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9cb9db2b-302e-460b-8154-5c1593a7c520 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:38.587303 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9cb9db2b-302e-460b-8154-5c1593a7c520 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:38.587711 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9cb9db2b-302e-460b-8154-5c1593a7c520 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:38.588924 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9cb9db2b-302e-460b-8154-5c1593a7c520 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:38.589385 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9cb9db2b-302e-460b-8154-5c1593a7c520 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:38.589809 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9cb9db2b-302e-460b-8154-5c1593a7c520 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:38.731313 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-9cb9db2b-302e-460b-8154-5c1593a7c520 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:38.742460 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9cb9db2b-302e-460b-8154-5c1593a7c520 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.163880 Aug 22 12:49:38.742460 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 192/377] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:38 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:38.899366 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d712aba2-0ee8-4282-86a8-35385881c8d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "POST /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.117102 Aug 22 12:49:38.900098 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 186/378] 10.222.0.15 () {62 vars in 1364 bytes} [Mon Aug 22 12:49:37 2022] POST /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments => generated 188 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:49:39.034563 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3a8c3621-675c-46a6-8ebc-97ba90ffcb19 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:49:39.035302 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-3a8c3621-675c-46a6-8ebc-97ba90ffcb19 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:39.042572 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3a8c3621-675c-46a6-8ebc-97ba90ffcb19 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:39.043174 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3a8c3621-675c-46a6-8ebc-97ba90ffcb19 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:39.043797 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3a8c3621-675c-46a6-8ebc-97ba90ffcb19 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:39.044519 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3a8c3621-675c-46a6-8ebc-97ba90ffcb19 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:39.044979 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3a8c3621-675c-46a6-8ebc-97ba90ffcb19 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:39.045441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3a8c3621-675c-46a6-8ebc-97ba90ffcb19 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:39.089317 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-3a8c3621-675c-46a6-8ebc-97ba90ffcb19 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127809) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 12:49:39.515610 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-3a8c3621-675c-46a6-8ebc-97ba90ffcb19 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "POST /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/action" status: 202 len: 0 microversion: 2.20 time: 0.485163 Aug 22 12:49:39.516487 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 193/379] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 22 12:49:39 2022] POST /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:49:39.525280 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:39.526424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:39.537196 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:39.537695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:39.538140 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:39.538938 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:39.539398 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:39.540474 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:39.676939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:39.687521 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:39.689539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:39.690936 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-269172be-753f-4b9b-9b75-533749a9c179 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1752 microversion: 2.20 time: 0.169739 Aug 22 12:49:39.691607 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 187/380] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:39 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:39.761428 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ff154640-d09a-4376-9d7e-fe5a6934145b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:39.762450 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ff154640-d09a-4376-9d7e-fe5a6934145b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:39.768899 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff154640-d09a-4376-9d7e-fe5a6934145b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:39.769384 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff154640-d09a-4376-9d7e-fe5a6934145b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:39.769818 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff154640-d09a-4376-9d7e-fe5a6934145b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:39.770535 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff154640-d09a-4376-9d7e-fe5a6934145b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:39.770990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff154640-d09a-4376-9d7e-fe5a6934145b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:39.771410 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ff154640-d09a-4376-9d7e-fe5a6934145b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:39.947006 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ff154640-d09a-4376-9d7e-fe5a6934145b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:39.956265 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ff154640-d09a-4376-9d7e-fe5a6934145b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.198594 Aug 22 12:49:39.957295 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 194/381] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:39 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:40.717934 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:40.720143 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:40.727196 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:40.727958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:40.728366 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:40.729117 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:40.729576 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:40.730002 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:40.864809 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:40.874393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:40.875958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:40.877103 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-050fff4e-ecf7-4c72-84fb-1a04f8fed8b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1752 microversion: 2.20 time: 0.167241 Aug 22 12:49:40.877799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 188/382] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:40 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:40.978432 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-4d72bd9f-f920-497d-9774-b40ce0bb2a95 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:40.979042 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-4d72bd9f-f920-497d-9774-b40ce0bb2a95 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:40.985034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4d72bd9f-f920-497d-9774-b40ce0bb2a95 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:40.985516 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4d72bd9f-f920-497d-9774-b40ce0bb2a95 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:40.985953 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4d72bd9f-f920-497d-9774-b40ce0bb2a95 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:40.986661 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4d72bd9f-f920-497d-9774-b40ce0bb2a95 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:40.987113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4d72bd9f-f920-497d-9774-b40ce0bb2a95 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:40.987535 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4d72bd9f-f920-497d-9774-b40ce0bb2a95 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:41.121990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4d72bd9f-f920-497d-9774-b40ce0bb2a95 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:41.135833 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-4d72bd9f-f920-497d-9774-b40ce0bb2a95 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1724 microversion: 2.1 time: 0.156574 Aug 22 12:49:41.135833 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 195/383] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:40 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:49:41.900838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:41.901940 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:41.908444 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:41.908925 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:41.909355 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:41.910040 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:41.910514 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:41.910939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:42.038463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:42.047517 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:42.049072 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:42.050256 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0234e26b-13c3-4358-a579-14c9bad34b39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1754 microversion: 2.20 time: 0.153316 Aug 22 12:49:42.050806 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 189/384] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:41 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:42.152553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b7a8cd1f-89f6-4cff-8540-26870925441b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:42.153104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b7a8cd1f-89f6-4cff-8540-26870925441b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:42.159057 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7a8cd1f-89f6-4cff-8540-26870925441b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:42.159572 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7a8cd1f-89f6-4cff-8540-26870925441b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:42.160011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7a8cd1f-89f6-4cff-8540-26870925441b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:42.160727 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7a8cd1f-89f6-4cff-8540-26870925441b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:42.161209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7a8cd1f-89f6-4cff-8540-26870925441b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:42.161641 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b7a8cd1f-89f6-4cff-8540-26870925441b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:42.296696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b7a8cd1f-89f6-4cff-8540-26870925441b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:42.306867 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b7a8cd1f-89f6-4cff-8540-26870925441b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1701 microversion: 2.1 time: 0.158748 Aug 22 12:49:42.307983 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 196/385] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:42 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:42.328168 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-98cc2b60-0617-4e24-b2e1-90ad77fc1162 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:49:42.334082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98cc2b60-0617-4e24-b2e1-90ad77fc1162 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:42.334605 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98cc2b60-0617-4e24-b2e1-90ad77fc1162 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:42.335040 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98cc2b60-0617-4e24-b2e1-90ad77fc1162 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:42.396344 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-98cc2b60-0617-4e24-b2e1-90ad77fc1162 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Going to try to start instance {{(pid=127810) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 22 12:49:42.662909 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-98cc2b60-0617-4e24-b2e1-90ad77fc1162 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "POST /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/action" status: 202 len: 0 microversion: 2.1 time: 0.338459 Aug 22 12:49:42.663516 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 190/386] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 12:49:42 2022] POST /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:49:42.672149 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ed5d1308-d94a-4a02-a4c7-0d86c77fc70a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:42.672768 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ed5d1308-d94a-4a02-a4c7-0d86c77fc70a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:42.678637 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed5d1308-d94a-4a02-a4c7-0d86c77fc70a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:42.679121 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed5d1308-d94a-4a02-a4c7-0d86c77fc70a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:42.679556 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed5d1308-d94a-4a02-a4c7-0d86c77fc70a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:42.680295 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed5d1308-d94a-4a02-a4c7-0d86c77fc70a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:42.680752 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed5d1308-d94a-4a02-a4c7-0d86c77fc70a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:42.681179 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed5d1308-d94a-4a02-a4c7-0d86c77fc70a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:42.811038 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ed5d1308-d94a-4a02-a4c7-0d86c77fc70a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:42.819175 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ed5d1308-d94a-4a02-a4c7-0d86c77fc70a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1710 microversion: 2.1 time: 0.150931 Aug 22 12:49:42.819764 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 197/387] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:42 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:43.073925 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:43.074679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:43.080935 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:43.081433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:43.081871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:43.082603 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:43.083060 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:43.083485 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:43.211172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:43.220341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:43.221901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:43.223155 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b5e8ed37-7bae-4696-a5f3-7a7a2cfd7db7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1754 microversion: 2.20 time: 0.153973 Aug 22 12:49:43.223724 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 191/388] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:43 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:43.843043 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2443b0a1-9503-4dad-ad2a-b468162fa787 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:43.843649 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2443b0a1-9503-4dad-ad2a-b468162fa787 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:43.849638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2443b0a1-9503-4dad-ad2a-b468162fa787 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:43.850125 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2443b0a1-9503-4dad-ad2a-b468162fa787 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:43.850604 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2443b0a1-9503-4dad-ad2a-b468162fa787 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:43.851299 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2443b0a1-9503-4dad-ad2a-b468162fa787 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:43.851807 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2443b0a1-9503-4dad-ad2a-b468162fa787 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:43.852242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2443b0a1-9503-4dad-ad2a-b468162fa787 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:43.983144 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2443b0a1-9503-4dad-ad2a-b468162fa787 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:43.991443 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2443b0a1-9503-4dad-ad2a-b468162fa787 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1710 microversion: 2.1 time: 0.153569 Aug 22 12:49:43.992075 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 198/389] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:43 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:44.246116 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:44.246672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:44.253290 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:44.253773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:44.254220 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:44.254908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:44.255354 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:44.255773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:44.386769 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:44.395250 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:44.396788 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:44.397937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8b6df0c0-c30c-4f28-b351-fa040b8f6d5f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1754 microversion: 2.20 time: 0.155805 Aug 22 12:49:44.398544 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 192/390] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:44 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:45.014225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c435413b-4502-4e09-854d-0a9daf9b5b97 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:45.014840 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c435413b-4502-4e09-854d-0a9daf9b5b97 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:45.021474 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c435413b-4502-4e09-854d-0a9daf9b5b97 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:45.022001 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c435413b-4502-4e09-854d-0a9daf9b5b97 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:45.022525 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c435413b-4502-4e09-854d-0a9daf9b5b97 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:45.023229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c435413b-4502-4e09-854d-0a9daf9b5b97 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:45.023683 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c435413b-4502-4e09-854d-0a9daf9b5b97 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:45.024104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c435413b-4502-4e09-854d-0a9daf9b5b97 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:45.162736 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c435413b-4502-4e09-854d-0a9daf9b5b97 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:45.171463 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c435413b-4502-4e09-854d-0a9daf9b5b97 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1710 microversion: 2.1 time: 0.162193 Aug 22 12:49:45.172034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 199/391] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:45 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:45.423017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:45.423632 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:45.430199 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:45.430953 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:45.431396 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:45.432102 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:45.432553 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:45.432977 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:45.568576 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:45.580077 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:45.581804 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:45.583213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-98843e80-1df3-4a3b-9394-0c0d7d96b5cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1754 microversion: 2.20 time: 0.164577 Aug 22 12:49:45.583960 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 193/392] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:45 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:46.192915 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-02d76b06-feaa-4e63-aa8c-91e134c4739b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:46.198219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-02d76b06-feaa-4e63-aa8c-91e134c4739b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:46.200553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02d76b06-feaa-4e63-aa8c-91e134c4739b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:46.201042 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02d76b06-feaa-4e63-aa8c-91e134c4739b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:46.201482 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02d76b06-feaa-4e63-aa8c-91e134c4739b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:46.202197 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02d76b06-feaa-4e63-aa8c-91e134c4739b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:46.202664 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02d76b06-feaa-4e63-aa8c-91e134c4739b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:46.203090 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02d76b06-feaa-4e63-aa8c-91e134c4739b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:46.338519 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-02d76b06-feaa-4e63-aa8c-91e134c4739b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:46.346772 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-02d76b06-feaa-4e63-aa8c-91e134c4739b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1710 microversion: 2.1 time: 0.157891 Aug 22 12:49:46.347364 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 200/393] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:46 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:49:46.609146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:46.609788 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:46.616521 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:46.617009 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:46.617446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:46.618145 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:46.618631 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:46.619061 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:46.938174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:46.946915 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:46.948449 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:46.949608 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d05b301b-47d6-48fc-9bd5-40468250f803 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1754 microversion: 2.20 time: 0.344400 Aug 22 12:49:46.950168 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 194/394] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:46 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1754 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:47.368696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e59e3d07-52cf-4789-af09-e34b5640e76f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:47.369312 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e59e3d07-52cf-4789-af09-e34b5640e76f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:47.375307 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e59e3d07-52cf-4789-af09-e34b5640e76f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:47.375796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e59e3d07-52cf-4789-af09-e34b5640e76f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:47.376239 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e59e3d07-52cf-4789-af09-e34b5640e76f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:47.376931 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e59e3d07-52cf-4789-af09-e34b5640e76f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:47.377398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e59e3d07-52cf-4789-af09-e34b5640e76f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:47.377826 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e59e3d07-52cf-4789-af09-e34b5640e76f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:47.507656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e59e3d07-52cf-4789-af09-e34b5640e76f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:47.516442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e59e3d07-52cf-4789-af09-e34b5640e76f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1714 microversion: 2.1 time: 0.151623 Aug 22 12:49:47.516999 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 201/395] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:49:47 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:49:47.972968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:47.973583 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:47.981184 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:47.981680 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:47.982119 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:47.982937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:47.983397 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:47.983829 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:48.115627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:48.124810 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:48.126350 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:48.127519 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-358be0b7-2cf8-4838-9894-6eb2245ff9f5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1754 microversion: 2.20 time: 0.158496 Aug 22 12:49:48.128080 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 195/396] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:47 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:49.150293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:49.150844 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:49.156963 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:49.157450 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:49.157918 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:49.158677 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:49.159138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:49.159566 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:49.163477 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:49.288678 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:49.298332 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:49.299844 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:49.300992 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-adc45f2b-ade0-4bfc-87cc-bed5c068cf6f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1754 microversion: 2.20 time: 0.154878 Aug 22 12:49:49.301690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 202/397] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:49 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:50.325567 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:50.326635 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:50.339477 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:50.340006 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:50.340440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:50.341141 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:50.341588 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:50.342095 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:50.475774 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:50.485328 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:50.486902 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:50.488132 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-be3c588b-11a3-4d70-a5aa-8eda408a133c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1754 microversion: 2.20 time: 0.167172 Aug 22 12:49:50.488768 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 196/398] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:50 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:51.511321 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:51.511943 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:51.517877 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:51.518401 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:51.518835 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:51.519530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:51.519987 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:51.525050 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:51.652710 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:51.661692 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:51.664335 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:51.665789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-905fa5a1-251e-43d6-a788-323e2345f5eb tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.158179 Aug 22 12:49:51.666794 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 203/399] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:51 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:52.689037 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:52.689589 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:52.696157 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:52.696644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:52.697080 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:52.697781 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:52.698764 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:52.699194 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:52.829004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:52.837809 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:52.839924 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:52.843949 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1c8a15dc-3081-411b-888f-2e22dabbbda3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.156044 Aug 22 12:49:52.843949 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 197/400] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:52 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:53.863779 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:53.864385 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:53.872455 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:53.873163 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:53.873896 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:53.874831 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:53.875291 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:53.875950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:54.009908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:54.019120 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:54.020640 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:54.021801 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-4bc21560-29ac-4b30-83bf-9f746c951a24 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.161868 Aug 22 12:49:54.022612 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 204/401] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:53 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:55.049784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:55.050448 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:55.057331 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:55.058453 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:55.062381 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:55.062381 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:55.062381 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:55.062381 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:55.064801 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:55.256599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:55.274814 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:55.278261 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:55.279965 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f8b0dbf6-e34e-4ab9-b67d-7bac47828c39 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.233983 Aug 22 12:49:55.304486 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 198/402] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:55 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:56.305626 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:56.309448 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:56.313341 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:56.314137 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:56.314840 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:56.315796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:56.316356 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:56.317104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:56.496130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:56.507085 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:56.508611 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:56.509778 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-3b4e04a7-e921-45d5-a00e-11d8d99a52ac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.208326 Aug 22 12:49:56.510819 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 205/403] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:56 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:49:57.537424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:57.538125 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:57.545649 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:57.546421 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:57.546859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:57.547568 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:57.548030 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:57.549002 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:57.700526 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:57.710312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:57.712420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:57.714549 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-55c5a9bd-cd2d-4acb-9532-1eec73677013 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.183444 Aug 22 12:49:57.715634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 199/404] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:57 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:58.738982 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:58.739660 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:58.742216 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:58.748828 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:58.749332 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:58.749778 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:58.750577 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:58.751041 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:58.751474 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:58.902292 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:58.910775 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:58.912293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:49:58.913468 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a4d5d5b0-187a-4264-8333-9d6df6df48b8 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.179016 Aug 22 12:49:58.914020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 206/405] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:58 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:49:59.938051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:49:59.938638 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:49:59.945202 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:59.946034 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:59.947009 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:49:59.948000 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:49:59.949178 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:49:59.949868 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:00.084736 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:00.094080 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:00.095852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:00.097223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1b9db94d-96ea-4fac-b774-d0616227e85d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.163375 Aug 22 12:50:00.097996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 200/406] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:49:59 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:01.120659 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:01.121517 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:01.128497 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:01.128998 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:01.129432 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:01.130214 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:01.130687 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:01.131109 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:01.320775 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:01.334461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:01.334461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:01.335776 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1de5d1f3-8b7b-465c-b277-5ca9f9d28db0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.219361 Aug 22 12:50:01.336442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 207/407] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:01 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:02.360113 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:02.361463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:02.368640 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:02.369392 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:02.370118 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:02.371285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:02.371819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:02.372324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:02.521636 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:02.531263 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:02.532790 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:02.533974 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-31df66a4-0e9a-4ef4-935e-37fdad2f2466 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.178107 Aug 22 12:50:02.534777 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 201/408] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:02 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:03.558455 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:03.559773 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:03.566737 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:03.570338 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:03.570338 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:03.570338 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:03.570338 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:03.570762 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:03.836102 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:03.850910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:03.853045 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:03.855028 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0edc9dc8-7ec2-4675-8fac-0ded3994bdff tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.301462 Aug 22 12:50:03.856114 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 208/409] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:03 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:04.877306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:04.877937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:04.884458 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:04.884950 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:04.885933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:04.886662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:04.887124 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:04.887553 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:05.023567 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:05.032897 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:05.034438 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:05.035600 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f91cecca-65ca-44a7-b637-d31e84bcf504 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.162233 Aug 22 12:50:05.036161 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 202/410] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:04 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:06.059218 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:06.060185 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:06.068775 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:06.069373 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:06.070069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:06.070930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:06.071501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:06.072036 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:06.237620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:06.248054 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:06.250065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:06.251306 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-09b59b3c-dd5e-48e2-bd4b-33ff85f032d5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.196938 Aug 22 12:50:06.251943 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 209/411] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:06 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:07.274469 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:07.275083 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:07.281960 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:07.282657 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:07.283031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:07.283718 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:07.284175 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:07.284598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:07.414516 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:07.423701 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:07.425199 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:07.426392 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-97287207-c626-483b-a6ad-932538517057 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.155837 Aug 22 12:50:07.426954 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 203/412] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:07 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:08.448413 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:08.449046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:08.455072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:08.455556 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:08.455996 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:08.456684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:08.457143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:08.457570 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:08.583930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:08.592622 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:08.594158 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:08.595345 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-679c006b-7f76-46de-b374-b08071672ba4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.150882 Aug 22 12:50:08.595900 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 210/413] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:08 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:09.619240 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:09.619787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:09.622152 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=40 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:09.626886 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:09.627379 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:09.627817 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:09.628538 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:09.628993 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:09.629408 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:09.766744 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:09.775730 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:09.777784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:09.780738 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7da80a8e-34f6-4c1d-8d32-a4a216bd0a0c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.165472 Aug 22 12:50:09.781312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 204/414] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:09 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:10.803642 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:10.804259 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:10.810381 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:10.810882 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:10.811335 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:10.817751 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:10.817751 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:10.817751 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:10.948435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:10.957000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:10.958570 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:10.961043 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-376da1d9-8114-492e-b53b-74c4130789f2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.160054 Aug 22 12:50:10.961043 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 211/415] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:10 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:11.983538 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:11.984173 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:11.990463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:11.990897 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:11.991329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:11.993860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:11.993860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:11.993860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:12.126256 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:12.134852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:12.136853 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:12.138002 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-86f57bf9-f72b-4a49-8322-6b839284013a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.158795 Aug 22 12:50:12.138596 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 205/416] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:11 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:13.161679 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:13.162227 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:13.168165 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:13.168653 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:13.169123 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:13.169785 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:13.170277 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:13.170708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:13.299513 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:13.308864 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:13.310389 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:13.311522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7cb765fe-9652-41bb-b308-44492d7d6184 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.153862 Aug 22 12:50:13.312084 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 212/417] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:13 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:14.334517 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:14.335052 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:14.341359 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:14.341844 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:14.342313 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:14.343002 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:14.343457 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:14.343885 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:14.472465 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:14.482319 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:14.483816 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:14.484969 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-048e4ff6-5351-4b40-9bde-ca521bbb3fea tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.154531 Aug 22 12:50:14.485516 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 206/418] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:14 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:15.509195 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:15.509927 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:15.516753 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:15.517250 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:15.520977 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:15.520977 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:15.520977 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:15.520977 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:15.644285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-b92631cf-9e52-428c-883b-a32a844118ab req-82135fc8-69bb-4f7b-9f42-7995190865e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e060778-7e35-44e9-99f4-f2fb64f07928", "name": "network-vif-plugged", "status": "completed", "tag": "b8fb88da-a096-4c45-bd62-6606ee956319"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:50:15.654386 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b92631cf-9e52-428c-883b-a32a844118ab req-82135fc8-69bb-4f7b-9f42-7995190865e1 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:15.654881 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b92631cf-9e52-428c-883b-a32a844118ab req-82135fc8-69bb-4f7b-9f42-7995190865e1 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:15.655314 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b92631cf-9e52-428c-883b-a32a844118ab req-82135fc8-69bb-4f7b-9f42-7995190865e1 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:15.662840 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:15.666426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-b92631cf-9e52-428c-883b-a32a844118ab req-82135fc8-69bb-4f7b-9f42-7995190865e1 service nova] Creating event network-vif-plugged:b8fb88da-a096-4c45-bd62-6606ee956319 for instance 4e060778-7e35-44e9-99f4-f2fb64f07928 on hv-cinder-85083 Aug 22 12:50:15.670803 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:15.671710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-b92631cf-9e52-428c-883b-a32a844118ab req-82135fc8-69bb-4f7b-9f42-7995190865e1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031220 Aug 22 12:50:15.672310 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 207/419] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:50:15.672455 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:15.675396 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-883135c7-e742-4f00-93a8-f263799b762f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.170497 Aug 22 12:50:15.675944 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 213/420] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:15 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:16.701093 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:16.701813 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:16.707987 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:16.708584 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:16.709084 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:16.709776 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:16.710249 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:16.710672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:16.846983 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:16.856583 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:16.858230 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:16.859454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-da133b72-c7eb-4b99-9b45-6cc67ef35301 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.163822 Aug 22 12:50:16.860017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 208/421] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:16 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:17.883216 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:17.883825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:17.890585 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:17.891018 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:17.891514 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:17.892332 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:17.892758 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:17.893239 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:18.034217 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:18.043789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:18.045281 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:18.046485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-07d99256-0447-41c0-ae4f-7436b852e352 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.167401 Aug 22 12:50:18.047261 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 214/422] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:17 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:19.071041 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:19.071666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:19.081274 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:19.081748 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:19.082198 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:19.082920 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:19.083376 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:19.083803 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:19.210131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:19.219425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:19.220921 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:19.222070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-529bc859-402d-4d0b-bb50-4692c8c74e3c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1810 microversion: 2.20 time: 0.154972 Aug 22 12:50:19.222663 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 209/423] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:19 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:19.698005 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a7d4c760-edc5-41ed-815e-c1155182c664 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a345e3b-f8b5-404d-97f2-df4fa5001a70"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:50:19.700641 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a7d4c760-edc5-41ed-815e-c1155182c664 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:19.706784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7d4c760-edc5-41ed-815e-c1155182c664 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:19.707275 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7d4c760-edc5-41ed-815e-c1155182c664 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:19.707713 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7d4c760-edc5-41ed-815e-c1155182c664 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:19.708410 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7d4c760-edc5-41ed-815e-c1155182c664 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:19.708870 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7d4c760-edc5-41ed-815e-c1155182c664 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:19.709355 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a7d4c760-edc5-41ed-815e-c1155182c664 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:19.712933 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=77 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:20.244903 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:20.245553 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:20.251987 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:20.252523 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:20.265563 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:20.265563 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:20.265563 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:20.265563 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:20.382036 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:20.392010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:20.393747 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:20.395098 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a3c540c0-10cb-45ca-af67-e9883ab50fee tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1797 microversion: 2.20 time: 0.154135 Aug 22 12:50:20.395646 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 210/424] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:20 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1797 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:50:20.567194 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a7d4c760-edc5-41ed-815e-c1155182c664 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "POST /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.872909 Aug 22 12:50:20.567834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 215/425] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:50:19 2022] POST /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:50:28.092867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7ada14df-f829-4815-aedf-28edbc9bc777 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:50:28.095140 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7ada14df-f829-4815-aedf-28edbc9bc777 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:28.101502 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ada14df-f829-4815-aedf-28edbc9bc777 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:28.101985 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ada14df-f829-4815-aedf-28edbc9bc777 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:28.102454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ada14df-f829-4815-aedf-28edbc9bc777 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:28.103503 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ada14df-f829-4815-aedf-28edbc9bc777 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:28.103956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ada14df-f829-4815-aedf-28edbc9bc777 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:28.104376 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ada14df-f829-4815-aedf-28edbc9bc777 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:28.106831 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=73 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:28.128076 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-7ada14df-f829-4815-aedf-28edbc9bc777 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lazy-loading 'flavor' on Instance uuid 59e67844-4079-4ba2-8edd-5c5023f9d4d4 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:50:28.440034 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7ada14df-f829-4815-aedf-28edbc9bc777 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "POST /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/action" status: 200 len: 32 microversion: 2.1 time: 0.353142 Aug 22 12:50:28.440584 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 211/426] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 12:50:28 2022] POST /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/action => generated 32 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 12:50:28.452754 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-acbad64d-aa24-4d04-a56b-13dc3834565b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:28.453449 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-acbad64d-aa24-4d04-a56b-13dc3834565b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:28.459624 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acbad64d-aa24-4d04-a56b-13dc3834565b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:28.460108 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acbad64d-aa24-4d04-a56b-13dc3834565b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:28.460543 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acbad64d-aa24-4d04-a56b-13dc3834565b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:28.461234 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acbad64d-aa24-4d04-a56b-13dc3834565b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:28.461688 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acbad64d-aa24-4d04-a56b-13dc3834565b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:28.462108 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acbad64d-aa24-4d04-a56b-13dc3834565b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:28.593003 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-acbad64d-aa24-4d04-a56b-13dc3834565b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:28.601211 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-acbad64d-aa24-4d04-a56b-13dc3834565b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.153921 Aug 22 12:50:28.601784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 216/427] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:28 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:50:29.127623 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 12:50:29.128058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Mon Aug 22 12:50:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 12:50:29.507224 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0cad4187-efae-480d-8455-55750f696b17 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:29.507801 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0cad4187-efae-480d-8455-55750f696b17 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:29.515177 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0cad4187-efae-480d-8455-55750f696b17 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:29.515665 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0cad4187-efae-480d-8455-55750f696b17 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:29.516105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0cad4187-efae-480d-8455-55750f696b17 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:29.516793 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0cad4187-efae-480d-8455-55750f696b17 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:29.517253 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0cad4187-efae-480d-8455-55750f696b17 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:29.517680 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0cad4187-efae-480d-8455-55750f696b17 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:29.622194 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-00557027-8668-41dd-a600-33f35ff3e93e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:29.622849 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-00557027-8668-41dd-a600-33f35ff3e93e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:29.625294 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=22 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:29.630087 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-00557027-8668-41dd-a600-33f35ff3e93e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:29.630631 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-00557027-8668-41dd-a600-33f35ff3e93e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:29.631075 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-00557027-8668-41dd-a600-33f35ff3e93e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:29.631770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-00557027-8668-41dd-a600-33f35ff3e93e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:29.632222 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-00557027-8668-41dd-a600-33f35ff3e93e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:29.632644 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-00557027-8668-41dd-a600-33f35ff3e93e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:29.640413 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-0cad4187-efae-480d-8455-55750f696b17 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lazy-loading 'services' on Instance uuid 48cd5dbe-4358-40f8-9515-87434787eca4 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:50:29.769671 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-00557027-8668-41dd-a600-33f35ff3e93e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:29.777822 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-00557027-8668-41dd-a600-33f35ff3e93e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.159406 Aug 22 12:50:29.778427 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 217/428] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:29 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:50:29.904579 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0cad4187-efae-480d-8455-55750f696b17 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "DELETE /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/os-volume_attachments/d312228b-588a-4b62-ad78-0000eddfbe68" status: 202 len: 0 microversion: 2.1 time: 0.401934 Aug 22 12:50:29.905297 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 212/429] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 12:50:29 2022] DELETE /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/os-volume_attachments/d312228b-588a-4b62-ad78-0000eddfbe68 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 12:50:30.800147 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-28fab2e6-e381-4470-86fb-d2d95b2adbdf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:30.800829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-28fab2e6-e381-4470-86fb-d2d95b2adbdf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:30.806881 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28fab2e6-e381-4470-86fb-d2d95b2adbdf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:30.807361 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28fab2e6-e381-4470-86fb-d2d95b2adbdf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:30.807789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28fab2e6-e381-4470-86fb-d2d95b2adbdf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:30.808470 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28fab2e6-e381-4470-86fb-d2d95b2adbdf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:30.808918 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28fab2e6-e381-4470-86fb-d2d95b2adbdf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:30.809337 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28fab2e6-e381-4470-86fb-d2d95b2adbdf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:30.937972 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-28fab2e6-e381-4470-86fb-d2d95b2adbdf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:30.946218 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-28fab2e6-e381-4470-86fb-d2d95b2adbdf tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.150176 Aug 22 12:50:30.946781 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 218/430] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:30 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:31.968540 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8fc6425f-8447-452b-9b0f-68373e04a30f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:31.969244 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8fc6425f-8447-452b-9b0f-68373e04a30f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:31.975956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc6425f-8447-452b-9b0f-68373e04a30f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:31.976462 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc6425f-8447-452b-9b0f-68373e04a30f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:31.976899 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc6425f-8447-452b-9b0f-68373e04a30f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:31.977593 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc6425f-8447-452b-9b0f-68373e04a30f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:31.978339 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc6425f-8447-452b-9b0f-68373e04a30f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:31.978774 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc6425f-8447-452b-9b0f-68373e04a30f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:32.078326 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5b81c5b2-f3d5-426f-b5f3-7bceb1aaac40 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:50:32.085000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5b81c5b2-f3d5-426f-b5f3-7bceb1aaac40 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:32.085445 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5b81c5b2-f3d5-426f-b5f3-7bceb1aaac40 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:32.085881 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5b81c5b2-f3d5-426f-b5f3-7bceb1aaac40 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:32.108824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-5b81c5b2-f3d5-426f-b5f3-7bceb1aaac40 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Going to try to stop instance {{(pid=127809) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 22 12:50:32.112700 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8fc6425f-8447-452b-9b0f-68373e04a30f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:32.120955 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8fc6425f-8447-452b-9b0f-68373e04a30f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.157600 Aug 22 12:50:32.121520 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 213/431] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:31 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:32.375588 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-5b81c5b2-f3d5-426f-b5f3-7bceb1aaac40 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "POST /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/action" status: 202 len: 0 microversion: 2.1 time: 0.300882 Aug 22 12:50:32.376321 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 219/432] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 12:50:32 2022] POST /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 12:50:32.384430 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-cf6d962b-17ee-4b2f-a9da-a3fdf6d2680e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:32.385069 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-cf6d962b-17ee-4b2f-a9da-a3fdf6d2680e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:32.391552 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf6d962b-17ee-4b2f-a9da-a3fdf6d2680e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:32.392041 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf6d962b-17ee-4b2f-a9da-a3fdf6d2680e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:32.392477 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf6d962b-17ee-4b2f-a9da-a3fdf6d2680e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:32.393172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf6d962b-17ee-4b2f-a9da-a3fdf6d2680e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:32.393627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf6d962b-17ee-4b2f-a9da-a3fdf6d2680e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:32.394054 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf6d962b-17ee-4b2f-a9da-a3fdf6d2680e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:32.522874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-cf6d962b-17ee-4b2f-a9da-a3fdf6d2680e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:32.531018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-cf6d962b-17ee-4b2f-a9da-a3fdf6d2680e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1678 microversion: 2.1 time: 0.150466 Aug 22 12:50:32.531578 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 214/433] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:32 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:33.142996 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6b9b0ce6-1c49-4270-8f18-5587b93c98c9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:33.143689 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6b9b0ce6-1c49-4270-8f18-5587b93c98c9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:33.149691 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b9b0ce6-1c49-4270-8f18-5587b93c98c9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:33.150168 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b9b0ce6-1c49-4270-8f18-5587b93c98c9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:33.150630 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b9b0ce6-1c49-4270-8f18-5587b93c98c9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:33.151308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b9b0ce6-1c49-4270-8f18-5587b93c98c9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:33.151758 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b9b0ce6-1c49-4270-8f18-5587b93c98c9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:33.152181 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b9b0ce6-1c49-4270-8f18-5587b93c98c9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:33.278822 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6b9b0ce6-1c49-4270-8f18-5587b93c98c9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:33.288237 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6b9b0ce6-1c49-4270-8f18-5587b93c98c9 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.149853 Aug 22 12:50:33.293461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 220/434] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:33 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:33.552098 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d547d4b4-c78b-48c4-9d68-5dc57b0bc835 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:33.552709 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d547d4b4-c78b-48c4-9d68-5dc57b0bc835 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:33.558990 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d547d4b4-c78b-48c4-9d68-5dc57b0bc835 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:33.559472 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d547d4b4-c78b-48c4-9d68-5dc57b0bc835 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:33.559905 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d547d4b4-c78b-48c4-9d68-5dc57b0bc835 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:33.560592 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d547d4b4-c78b-48c4-9d68-5dc57b0bc835 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:33.561046 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d547d4b4-c78b-48c4-9d68-5dc57b0bc835 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:33.561474 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d547d4b4-c78b-48c4-9d68-5dc57b0bc835 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:33.685912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d547d4b4-c78b-48c4-9d68-5dc57b0bc835 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:33.693499 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d547d4b4-c78b-48c4-9d68-5dc57b0bc835 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1678 microversion: 2.1 time: 0.145210 Aug 22 12:50:33.694071 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 215/435] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:33 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:34.308787 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-56bbeaf4-773f-4e02-8bba-a8985eaf011e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:34.309402 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-56bbeaf4-773f-4e02-8bba-a8985eaf011e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:34.315796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-56bbeaf4-773f-4e02-8bba-a8985eaf011e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:34.316282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-56bbeaf4-773f-4e02-8bba-a8985eaf011e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:34.316715 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-56bbeaf4-773f-4e02-8bba-a8985eaf011e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:34.317405 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-56bbeaf4-773f-4e02-8bba-a8985eaf011e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:34.317861 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-56bbeaf4-773f-4e02-8bba-a8985eaf011e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:34.318319 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-56bbeaf4-773f-4e02-8bba-a8985eaf011e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:34.448178 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-56bbeaf4-773f-4e02-8bba-a8985eaf011e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:34.456210 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-56bbeaf4-773f-4e02-8bba-a8985eaf011e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.151275 Aug 22 12:50:34.456779 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 221/436] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:34 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:34.715508 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3c23dd3d-2bc8-40c8-8df8-842cb0862020 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:34.716040 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3c23dd3d-2bc8-40c8-8df8-842cb0862020 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:34.722936 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c23dd3d-2bc8-40c8-8df8-842cb0862020 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:34.723424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c23dd3d-2bc8-40c8-8df8-842cb0862020 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:34.723863 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c23dd3d-2bc8-40c8-8df8-842cb0862020 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:34.724560 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c23dd3d-2bc8-40c8-8df8-842cb0862020 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:34.725020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c23dd3d-2bc8-40c8-8df8-842cb0862020 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:34.725447 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c23dd3d-2bc8-40c8-8df8-842cb0862020 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:34.853229 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3c23dd3d-2bc8-40c8-8df8-842cb0862020 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:34.861095 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3c23dd3d-2bc8-40c8-8df8-842cb0862020 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1678 microversion: 2.1 time: 0.149592 Aug 22 12:50:34.867595 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 216/437] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:34 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:35.477997 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-95644938-8c19-4d77-ae6d-3cf16b72d3ae tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:35.478683 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-95644938-8c19-4d77-ae6d-3cf16b72d3ae tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:35.484997 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95644938-8c19-4d77-ae6d-3cf16b72d3ae tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:35.485475 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95644938-8c19-4d77-ae6d-3cf16b72d3ae tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:35.485908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95644938-8c19-4d77-ae6d-3cf16b72d3ae tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:35.486617 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95644938-8c19-4d77-ae6d-3cf16b72d3ae tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:35.487067 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95644938-8c19-4d77-ae6d-3cf16b72d3ae tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:35.487493 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95644938-8c19-4d77-ae6d-3cf16b72d3ae tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:35.629216 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-95644938-8c19-4d77-ae6d-3cf16b72d3ae tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:35.637276 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-95644938-8c19-4d77-ae6d-3cf16b72d3ae tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.163567 Aug 22 12:50:35.637835 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 222/438] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:35 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:35.883271 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b02d3415-bd92-49bd-bf69-02ef09afb3e9 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:35.883833 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b02d3415-bd92-49bd-bf69-02ef09afb3e9 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:35.890099 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b02d3415-bd92-49bd-bf69-02ef09afb3e9 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:35.890614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b02d3415-bd92-49bd-bf69-02ef09afb3e9 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:35.891050 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b02d3415-bd92-49bd-bf69-02ef09afb3e9 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:35.891735 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b02d3415-bd92-49bd-bf69-02ef09afb3e9 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:35.892190 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b02d3415-bd92-49bd-bf69-02ef09afb3e9 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:35.892617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b02d3415-bd92-49bd-bf69-02ef09afb3e9 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:36.023069 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b02d3415-bd92-49bd-bf69-02ef09afb3e9 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:36.031350 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b02d3415-bd92-49bd-bf69-02ef09afb3e9 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1678 microversion: 2.1 time: 0.152020 Aug 22 12:50:36.031912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 217/439] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:35 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:36.659097 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1462ab2c-c141-42b7-9195-246f5fcb7fa3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:36.659623 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1462ab2c-c141-42b7-9195-246f5fcb7fa3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:36.665879 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1462ab2c-c141-42b7-9195-246f5fcb7fa3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:36.666393 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1462ab2c-c141-42b7-9195-246f5fcb7fa3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:36.666825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1462ab2c-c141-42b7-9195-246f5fcb7fa3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:36.667507 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1462ab2c-c141-42b7-9195-246f5fcb7fa3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:36.667962 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1462ab2c-c141-42b7-9195-246f5fcb7fa3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:36.668382 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1462ab2c-c141-42b7-9195-246f5fcb7fa3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:36.793836 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1462ab2c-c141-42b7-9195-246f5fcb7fa3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:36.801900 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1462ab2c-c141-42b7-9195-246f5fcb7fa3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.146725 Aug 22 12:50:36.802487 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 223/440] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:36 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:37.052952 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-64575341-e158-4b17-90b6-69b368301b2d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:37.053567 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-64575341-e158-4b17-90b6-69b368301b2d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:37.060471 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64575341-e158-4b17-90b6-69b368301b2d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:37.060993 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64575341-e158-4b17-90b6-69b368301b2d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:37.061430 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64575341-e158-4b17-90b6-69b368301b2d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:37.062125 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64575341-e158-4b17-90b6-69b368301b2d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:37.062610 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64575341-e158-4b17-90b6-69b368301b2d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:37.063044 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-64575341-e158-4b17-90b6-69b368301b2d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:37.189752 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-64575341-e158-4b17-90b6-69b368301b2d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:37.197384 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-64575341-e158-4b17-90b6-69b368301b2d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1678 microversion: 2.1 time: 0.148319 Aug 22 12:50:37.197950 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 218/441] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:37 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:37.823746 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-db7f3da1-825e-4d5f-a805-ebdfaccec46f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:37.824350 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-db7f3da1-825e-4d5f-a805-ebdfaccec46f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:37.831228 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db7f3da1-825e-4d5f-a805-ebdfaccec46f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:37.831706 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db7f3da1-825e-4d5f-a805-ebdfaccec46f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:37.832134 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db7f3da1-825e-4d5f-a805-ebdfaccec46f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:37.833127 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db7f3da1-825e-4d5f-a805-ebdfaccec46f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:37.833582 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db7f3da1-825e-4d5f-a805-ebdfaccec46f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:37.834009 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-db7f3da1-825e-4d5f-a805-ebdfaccec46f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:37.959131 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-db7f3da1-825e-4d5f-a805-ebdfaccec46f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:37.968680 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-db7f3da1-825e-4d5f-a805-ebdfaccec46f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.148700 Aug 22 12:50:37.969264 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 224/442] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:37 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:38.218368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-9fc63bce-aa1f-41e6-8304-f9545a85318b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:38.218933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-9fc63bce-aa1f-41e6-8304-f9545a85318b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:38.225269 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9fc63bce-aa1f-41e6-8304-f9545a85318b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:38.225752 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9fc63bce-aa1f-41e6-8304-f9545a85318b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:38.226228 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9fc63bce-aa1f-41e6-8304-f9545a85318b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:38.226915 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9fc63bce-aa1f-41e6-8304-f9545a85318b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:38.227402 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9fc63bce-aa1f-41e6-8304-f9545a85318b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:38.228078 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9fc63bce-aa1f-41e6-8304-f9545a85318b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:38.359856 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9fc63bce-aa1f-41e6-8304-f9545a85318b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:38.367480 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-9fc63bce-aa1f-41e6-8304-f9545a85318b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1678 microversion: 2.1 time: 0.153099 Aug 22 12:50:38.368052 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 219/443] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:38 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:38.990099 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6a76e1f2-3dbb-4f35-a503-15a6089873e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:38.990795 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6a76e1f2-3dbb-4f35-a503-15a6089873e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:38.997150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a76e1f2-3dbb-4f35-a503-15a6089873e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:38.997758 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a76e1f2-3dbb-4f35-a503-15a6089873e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:38.998223 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a76e1f2-3dbb-4f35-a503-15a6089873e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:38.998919 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a76e1f2-3dbb-4f35-a503-15a6089873e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:38.999376 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a76e1f2-3dbb-4f35-a503-15a6089873e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:38.999863 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6a76e1f2-3dbb-4f35-a503-15a6089873e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:39.126961 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6a76e1f2-3dbb-4f35-a503-15a6089873e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:39.135360 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6a76e1f2-3dbb-4f35-a503-15a6089873e3 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.149045 Aug 22 12:50:39.135868 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 225/444] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:38 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:39.389076 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b596cb77-0d2a-4595-b67f-cfc77ad71c6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:39.389624 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b596cb77-0d2a-4595-b67f-cfc77ad71c6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:39.395868 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b596cb77-0d2a-4595-b67f-cfc77ad71c6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:39.396351 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b596cb77-0d2a-4595-b67f-cfc77ad71c6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:39.396786 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b596cb77-0d2a-4595-b67f-cfc77ad71c6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:39.397479 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b596cb77-0d2a-4595-b67f-cfc77ad71c6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:39.397932 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b596cb77-0d2a-4595-b67f-cfc77ad71c6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:39.398385 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b596cb77-0d2a-4595-b67f-cfc77ad71c6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:39.529431 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b596cb77-0d2a-4595-b67f-cfc77ad71c6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:39.537405 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b596cb77-0d2a-4595-b67f-cfc77ad71c6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1678 microversion: 2.1 time: 0.152688 Aug 22 12:50:39.537979 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 220/445] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:39 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:40.157829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8b3a2454-1b9d-4e05-b2fe-32a408518b67 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:40.158465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8b3a2454-1b9d-4e05-b2fe-32a408518b67 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:40.164863 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b3a2454-1b9d-4e05-b2fe-32a408518b67 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:40.165344 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b3a2454-1b9d-4e05-b2fe-32a408518b67 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:40.165776 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b3a2454-1b9d-4e05-b2fe-32a408518b67 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:40.166488 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b3a2454-1b9d-4e05-b2fe-32a408518b67 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:40.166942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b3a2454-1b9d-4e05-b2fe-32a408518b67 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:40.167361 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b3a2454-1b9d-4e05-b2fe-32a408518b67 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:40.292626 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8b3a2454-1b9d-4e05-b2fe-32a408518b67 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:40.300703 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8b3a2454-1b9d-4e05-b2fe-32a408518b67 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.147370 Aug 22 12:50:40.304600 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 226/446] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:40 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:40.558160 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3d2049d5-b456-469f-9541-a279b9f1bd6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:40.558796 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3d2049d5-b456-469f-9541-a279b9f1bd6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:40.565644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2049d5-b456-469f-9541-a279b9f1bd6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:40.566155 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2049d5-b456-469f-9541-a279b9f1bd6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:40.566629 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2049d5-b456-469f-9541-a279b9f1bd6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:40.567318 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2049d5-b456-469f-9541-a279b9f1bd6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:40.567900 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2049d5-b456-469f-9541-a279b9f1bd6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:40.568326 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3d2049d5-b456-469f-9541-a279b9f1bd6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:40.693474 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3d2049d5-b456-469f-9541-a279b9f1bd6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:40.701934 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3d2049d5-b456-469f-9541-a279b9f1bd6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1678 microversion: 2.1 time: 0.147479 Aug 22 12:50:40.702545 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 221/447] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:40 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:41.322263 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ba4c297b-6d01-46b9-8ec3-d3cdb2d25910 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:41.322870 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ba4c297b-6d01-46b9-8ec3-d3cdb2d25910 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:41.329858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ba4c297b-6d01-46b9-8ec3-d3cdb2d25910 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:41.330391 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ba4c297b-6d01-46b9-8ec3-d3cdb2d25910 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:41.330995 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ba4c297b-6d01-46b9-8ec3-d3cdb2d25910 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:41.331687 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ba4c297b-6d01-46b9-8ec3-d3cdb2d25910 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:41.332141 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ba4c297b-6d01-46b9-8ec3-d3cdb2d25910 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:41.332648 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ba4c297b-6d01-46b9-8ec3-d3cdb2d25910 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:41.465062 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ba4c297b-6d01-46b9-8ec3-d3cdb2d25910 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:41.473665 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ba4c297b-6d01-46b9-8ec3-d3cdb2d25910 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.155267 Aug 22 12:50:41.474240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 227/448] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:41 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:41.723814 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-de342137-959a-4aca-949a-a3cb03210bf1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:41.724436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-de342137-959a-4aca-949a-a3cb03210bf1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:41.731191 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de342137-959a-4aca-949a-a3cb03210bf1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:41.731727 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de342137-959a-4aca-949a-a3cb03210bf1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:41.732170 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de342137-959a-4aca-949a-a3cb03210bf1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:41.732884 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de342137-959a-4aca-949a-a3cb03210bf1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:41.733350 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de342137-959a-4aca-949a-a3cb03210bf1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:41.733778 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de342137-959a-4aca-949a-a3cb03210bf1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:41.871413 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-de342137-959a-4aca-949a-a3cb03210bf1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:41.879744 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-de342137-959a-4aca-949a-a3cb03210bf1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1678 microversion: 2.1 time: 0.159873 Aug 22 12:50:41.880333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 222/449] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:41 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:42.494908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-53ff1f4a-3ba2-45ac-9596-8dd6a5601ef4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:42.495422 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-53ff1f4a-3ba2-45ac-9596-8dd6a5601ef4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:42.501743 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ff1f4a-3ba2-45ac-9596-8dd6a5601ef4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:42.502249 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ff1f4a-3ba2-45ac-9596-8dd6a5601ef4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:42.502685 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ff1f4a-3ba2-45ac-9596-8dd6a5601ef4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:42.503372 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ff1f4a-3ba2-45ac-9596-8dd6a5601ef4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:42.503821 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ff1f4a-3ba2-45ac-9596-8dd6a5601ef4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:42.504242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-53ff1f4a-3ba2-45ac-9596-8dd6a5601ef4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:42.632254 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-53ff1f4a-3ba2-45ac-9596-8dd6a5601ef4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:42.640707 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-53ff1f4a-3ba2-45ac-9596-8dd6a5601ef4 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.149732 Aug 22 12:50:42.641264 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 228/450] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:42 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:42.900733 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e6ab234a-4300-4357-b523-d65f433b8b91 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:42.902128 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e6ab234a-4300-4357-b523-d65f433b8b91 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:42.904564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=38 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:42.909257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ab234a-4300-4357-b523-d65f433b8b91 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:42.909745 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ab234a-4300-4357-b523-d65f433b8b91 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:42.910238 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ab234a-4300-4357-b523-d65f433b8b91 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:42.910913 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ab234a-4300-4357-b523-d65f433b8b91 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:42.911363 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ab234a-4300-4357-b523-d65f433b8b91 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:42.911786 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ab234a-4300-4357-b523-d65f433b8b91 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:43.038428 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e6ab234a-4300-4357-b523-d65f433b8b91 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:43.046100 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e6ab234a-4300-4357-b523-d65f433b8b91 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1678 microversion: 2.1 time: 0.149162 Aug 22 12:50:43.046718 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 223/451] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:42 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:43.662264 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6dd55b22-d922-4bff-bdfd-9ad99fd2a25a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:43.662833 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6dd55b22-d922-4bff-bdfd-9ad99fd2a25a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:43.669215 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd55b22-d922-4bff-bdfd-9ad99fd2a25a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:43.669701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd55b22-d922-4bff-bdfd-9ad99fd2a25a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:43.670138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd55b22-d922-4bff-bdfd-9ad99fd2a25a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:43.670856 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd55b22-d922-4bff-bdfd-9ad99fd2a25a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:43.671310 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd55b22-d922-4bff-bdfd-9ad99fd2a25a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:43.671734 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd55b22-d922-4bff-bdfd-9ad99fd2a25a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:43.687028 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:43.798993 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6dd55b22-d922-4bff-bdfd-9ad99fd2a25a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:43.814551 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6dd55b22-d922-4bff-bdfd-9ad99fd2a25a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.156149 Aug 22 12:50:43.815120 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 229/452] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:43 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:44.066786 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8ee7c0bb-5a34-4efc-bb51-d9618914350e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:44.067906 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8ee7c0bb-5a34-4efc-bb51-d9618914350e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:44.073607 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ee7c0bb-5a34-4efc-bb51-d9618914350e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:44.074109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ee7c0bb-5a34-4efc-bb51-d9618914350e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:44.074545 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ee7c0bb-5a34-4efc-bb51-d9618914350e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:44.075225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ee7c0bb-5a34-4efc-bb51-d9618914350e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:44.075675 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ee7c0bb-5a34-4efc-bb51-d9618914350e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:44.076091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ee7c0bb-5a34-4efc-bb51-d9618914350e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:44.202964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8ee7c0bb-5a34-4efc-bb51-d9618914350e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:44.210618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8ee7c0bb-5a34-4efc-bb51-d9618914350e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1655 microversion: 2.1 time: 0.147691 Aug 22 12:50:44.211178 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 224/453] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:44 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:44.230976 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-71cb84a8-4db3-4ae9-a819-79b7feee7022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:50:44.237822 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-71cb84a8-4db3-4ae9-a819-79b7feee7022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:44.238362 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-71cb84a8-4db3-4ae9-a819-79b7feee7022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:44.238829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-71cb84a8-4db3-4ae9-a819-79b7feee7022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:44.260133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-71cb84a8-4db3-4ae9-a819-79b7feee7022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Going to try to start instance {{(pid=127809) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 22 12:50:44.480130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-71cb84a8-4db3-4ae9-a819-79b7feee7022 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "POST /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/action" status: 202 len: 0 microversion: 2.1 time: 0.253051 Aug 22 12:50:44.481056 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 230/454] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 12:50:44 2022] POST /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:50:44.489750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2f09f6f5-52cf-463d-9f31-d29fc0f26592 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:44.490475 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2f09f6f5-52cf-463d-9f31-d29fc0f26592 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:44.497063 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2f09f6f5-52cf-463d-9f31-d29fc0f26592 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:44.497558 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2f09f6f5-52cf-463d-9f31-d29fc0f26592 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:44.497997 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2f09f6f5-52cf-463d-9f31-d29fc0f26592 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:44.498799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2f09f6f5-52cf-463d-9f31-d29fc0f26592 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:44.499281 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2f09f6f5-52cf-463d-9f31-d29fc0f26592 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:44.499709 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2f09f6f5-52cf-463d-9f31-d29fc0f26592 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:44.502397 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:44.625475 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2f09f6f5-52cf-463d-9f31-d29fc0f26592 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:44.632920 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2f09f6f5-52cf-463d-9f31-d29fc0f26592 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1664 microversion: 2.1 time: 0.146991 Aug 22 12:50:44.633487 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 225/455] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:44 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1664 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:44.837897 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-01d76a69-c14f-45b2-add7-710701ded983 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:44.838626 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-01d76a69-c14f-45b2-add7-710701ded983 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:44.845512 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-01d76a69-c14f-45b2-add7-710701ded983 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:44.846046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-01d76a69-c14f-45b2-add7-710701ded983 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:44.846510 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-01d76a69-c14f-45b2-add7-710701ded983 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:44.847208 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-01d76a69-c14f-45b2-add7-710701ded983 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:44.847663 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-01d76a69-c14f-45b2-add7-710701ded983 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:44.851116 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-01d76a69-c14f-45b2-add7-710701ded983 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:44.976837 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-01d76a69-c14f-45b2-add7-710701ded983 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:44.985368 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-01d76a69-c14f-45b2-add7-710701ded983 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.152292 Aug 22 12:50:44.985930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 231/456] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:44 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:45.653032 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4bc1e5af-9412-45c2-a2aa-006c474780e5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:45.653641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4bc1e5af-9412-45c2-a2aa-006c474780e5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:45.660231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4bc1e5af-9412-45c2-a2aa-006c474780e5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:45.660712 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4bc1e5af-9412-45c2-a2aa-006c474780e5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:45.661139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4bc1e5af-9412-45c2-a2aa-006c474780e5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:45.661817 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4bc1e5af-9412-45c2-a2aa-006c474780e5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:45.662292 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4bc1e5af-9412-45c2-a2aa-006c474780e5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:45.662713 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4bc1e5af-9412-45c2-a2aa-006c474780e5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:45.791507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-4bc1e5af-9412-45c2-a2aa-006c474780e5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:45.799481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4bc1e5af-9412-45c2-a2aa-006c474780e5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1664 microversion: 2.1 time: 0.150604 Aug 22 12:50:45.800036 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 226/457] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:45 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:46.006495 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-fc759d70-fc59-4def-831a-1231e998fe61 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:46.007115 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-fc759d70-fc59-4def-831a-1231e998fe61 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:46.013420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fc759d70-fc59-4def-831a-1231e998fe61 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:46.013903 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fc759d70-fc59-4def-831a-1231e998fe61 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:46.014387 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fc759d70-fc59-4def-831a-1231e998fe61 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:46.015086 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fc759d70-fc59-4def-831a-1231e998fe61 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:46.015541 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fc759d70-fc59-4def-831a-1231e998fe61 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:46.015983 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fc759d70-fc59-4def-831a-1231e998fe61 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:46.139229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-fc759d70-fc59-4def-831a-1231e998fe61 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:46.147255 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-fc759d70-fc59-4def-831a-1231e998fe61 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.144716 Aug 22 12:50:46.147816 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 232/458] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:46 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:46.820792 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-00656ef7-3277-43cd-8d3a-78dabdc7d796 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:46.821434 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-00656ef7-3277-43cd-8d3a-78dabdc7d796 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:46.828487 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-00656ef7-3277-43cd-8d3a-78dabdc7d796 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:46.828979 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-00656ef7-3277-43cd-8d3a-78dabdc7d796 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:46.829401 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-00656ef7-3277-43cd-8d3a-78dabdc7d796 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:46.830130 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-00656ef7-3277-43cd-8d3a-78dabdc7d796 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:46.830604 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-00656ef7-3277-43cd-8d3a-78dabdc7d796 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:46.831025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-00656ef7-3277-43cd-8d3a-78dabdc7d796 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:46.956534 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-00656ef7-3277-43cd-8d3a-78dabdc7d796 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:46.964461 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-00656ef7-3277-43cd-8d3a-78dabdc7d796 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1664 microversion: 2.1 time: 0.147490 Aug 22 12:50:46.965020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 227/459] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:46 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:47.169363 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-43a3e79c-bdfa-4e24-a59f-7aa56dba912a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:47.169991 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-43a3e79c-bdfa-4e24-a59f-7aa56dba912a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:47.176672 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43a3e79c-bdfa-4e24-a59f-7aa56dba912a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:47.177186 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43a3e79c-bdfa-4e24-a59f-7aa56dba912a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:47.177626 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43a3e79c-bdfa-4e24-a59f-7aa56dba912a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:47.178351 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43a3e79c-bdfa-4e24-a59f-7aa56dba912a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:47.178809 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43a3e79c-bdfa-4e24-a59f-7aa56dba912a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:47.179236 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43a3e79c-bdfa-4e24-a59f-7aa56dba912a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:47.312069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-43a3e79c-bdfa-4e24-a59f-7aa56dba912a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:47.320522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-43a3e79c-bdfa-4e24-a59f-7aa56dba912a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1734 microversion: 2.1 time: 0.155600 Aug 22 12:50:47.321967 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 233/460] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:47 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:47.985054 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a8df4f44-d5e0-4d2b-9564-731da034b905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:47.985673 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a8df4f44-d5e0-4d2b-9564-731da034b905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:47.992099 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a8df4f44-d5e0-4d2b-9564-731da034b905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:47.992617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a8df4f44-d5e0-4d2b-9564-731da034b905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:47.993054 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a8df4f44-d5e0-4d2b-9564-731da034b905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:47.993750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a8df4f44-d5e0-4d2b-9564-731da034b905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:47.994300 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a8df4f44-d5e0-4d2b-9564-731da034b905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:47.994730 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a8df4f44-d5e0-4d2b-9564-731da034b905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:48.127631 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a8df4f44-d5e0-4d2b-9564-731da034b905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:48.135584 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a8df4f44-d5e0-4d2b-9564-731da034b905 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1664 microversion: 2.1 time: 0.154412 Aug 22 12:50:48.136101 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 228/461] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:47 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:48.342721 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0ea746c7-4ba4-4e78-b4fe-fbdc9648cb2e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:48.343362 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0ea746c7-4ba4-4e78-b4fe-fbdc9648cb2e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:48.350597 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0ea746c7-4ba4-4e78-b4fe-fbdc9648cb2e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:48.351084 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0ea746c7-4ba4-4e78-b4fe-fbdc9648cb2e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:48.351523 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0ea746c7-4ba4-4e78-b4fe-fbdc9648cb2e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:48.352218 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0ea746c7-4ba4-4e78-b4fe-fbdc9648cb2e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:48.352942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0ea746c7-4ba4-4e78-b4fe-fbdc9648cb2e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:48.353370 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0ea746c7-4ba4-4e78-b4fe-fbdc9648cb2e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:48.482927 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0ea746c7-4ba4-4e78-b4fe-fbdc9648cb2e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:48.491153 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0ea746c7-4ba4-4e78-b4fe-fbdc9648cb2e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1714 microversion: 2.1 time: 0.152251 Aug 22 12:50:48.491738 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 234/462] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:48 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:48.597074 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:48.597569 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:48.603712 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:48.604187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:48.604614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:48.605292 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:48.605739 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:48.606674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:48.838460 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] HTTP exception thrown: Cannot 'detach_volume' instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 while it is in vm_state rescued Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Request method failure captured: Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: DELETE /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments/4a345e3b-f8b5-404d-97f2-df4fa5001a70 HTTP/1.1 Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rHTwMTo6zGt_ez_vmdEnfXSSDlW_ImyAeBjZj5lPt9LtxzxK-5VBTsf3eRd136OGLX0aofzvbz2KqrBKfOr6yVt5iXGUXXbBLQCzrCJRuuhXMl3GBJuSZzIjP1u4jmmlxE81HPMY7Casqzy1V5P9wc5vH205JPMnat-aavB0Eamzk Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 30bf0498eabd4d9988b2084c0b082fad Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:50:48.840051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:50:48.841944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30bf0498eabd4d9988b2084c0b082fad"}]}] Aug 22 12:50:48.841944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:50:48.841944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 30bf0498eabd4d9988b2084c0b082fad Aug 22 12:50:48.841944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:50:48.841944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-ServerRescueNegativeTestJSON-93198942-project Aug 22 12:50:48.841944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:50:48.841944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:50:48.841944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 9767d18cf0944f16b45fff4214128c1a Aug 22 12:50:48.841944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-93198942-project Aug 22 12:50:48.841944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:50:48.841944 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Cannot 'detach_volume' instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 while it is in vm_state rescued Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'server_id': '59e67844-4079-4ba2-8edd-5c5023f9d4d4', 'id': '4a345e3b-f8b5-404d-97f2-df4fa5001a70'} Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:50:48.842669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 while it is in vm_state rescued Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 while it is in vm_state rescued Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:50:48.844225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Returning 409 to user: Cannot 'detach_volume' instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 while it is in vm_state rescued {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:50:48.845374 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-067ff15f-9c8e-4be0-8021-6dd5d5ca0a3c tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments/4a345e3b-f8b5-404d-97f2-df4fa5001a70" status: 409 len: 152 microversion: 2.1 time: 0.248851 Aug 22 12:50:48.845374 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 229/463] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 12:50:48 2022] DELETE /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments/4a345e3b-f8b5-404d-97f2-df4fa5001a70 => generated 152 bytes in 250 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 22 12:50:48.850951 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-de09010c-5426-4190-a1a1-4d18a5371d45 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:50:48.851637 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-de09010c-5426-4190-a1a1-4d18a5371d45 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:48.858266 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de09010c-5426-4190-a1a1-4d18a5371d45 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:48.858747 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de09010c-5426-4190-a1a1-4d18a5371d45 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:48.859178 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de09010c-5426-4190-a1a1-4d18a5371d45 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:48.859861 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de09010c-5426-4190-a1a1-4d18a5371d45 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:48.860312 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de09010c-5426-4190-a1a1-4d18a5371d45 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:48.860728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de09010c-5426-4190-a1a1-4d18a5371d45 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:49.085816 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-de09010c-5426-4190-a1a1-4d18a5371d45 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "POST /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/action" status: 202 len: 0 microversion: 2.1 time: 0.238458 Aug 22 12:50:49.086421 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 235/464] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 12:50:48 2022] POST /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:50:49.095180 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ede24d08-1f7b-4c8e-a933-7d6f65b5c601 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:49.095796 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ede24d08-1f7b-4c8e-a933-7d6f65b5c601 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:49.102328 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ede24d08-1f7b-4c8e-a933-7d6f65b5c601 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:49.103082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ede24d08-1f7b-4c8e-a933-7d6f65b5c601 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:49.103524 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ede24d08-1f7b-4c8e-a933-7d6f65b5c601 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:49.104222 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ede24d08-1f7b-4c8e-a933-7d6f65b5c601 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:49.104685 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ede24d08-1f7b-4c8e-a933-7d6f65b5c601 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:49.105112 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ede24d08-1f7b-4c8e-a933-7d6f65b5c601 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:49.157697 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dbda714e-fe8b-434c-bd20-d34c1493b48c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:49.158534 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-dbda714e-fe8b-434c-bd20-d34c1493b48c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:49.164627 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dbda714e-fe8b-434c-bd20-d34c1493b48c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:49.165117 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dbda714e-fe8b-434c-bd20-d34c1493b48c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:49.165559 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dbda714e-fe8b-434c-bd20-d34c1493b48c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:49.166379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dbda714e-fe8b-434c-bd20-d34c1493b48c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:49.166845 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dbda714e-fe8b-434c-bd20-d34c1493b48c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:49.170711 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dbda714e-fe8b-434c-bd20-d34c1493b48c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:49.275361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ede24d08-1f7b-4c8e-a933-7d6f65b5c601 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:49.286822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ede24d08-1f7b-4c8e-a933-7d6f65b5c601 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1722 microversion: 2.1 time: 0.194314 Aug 22 12:50:49.300618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 230/465] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:49 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:49.323203 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-dbda714e-fe8b-434c-bd20-d34c1493b48c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:49.331463 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-dbda714e-fe8b-434c-bd20-d34c1493b48c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1668 microversion: 2.1 time: 0.178339 Aug 22 12:50:49.332038 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 236/466] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:49 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1668 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:50:50.308691 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6aaedd66-bcd8-467c-8729-ee499e5b7752 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:50.309341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6aaedd66-bcd8-467c-8729-ee499e5b7752 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:50.316326 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6aaedd66-bcd8-467c-8729-ee499e5b7752 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:50.316839 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6aaedd66-bcd8-467c-8729-ee499e5b7752 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:50.317458 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6aaedd66-bcd8-467c-8729-ee499e5b7752 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:50.318160 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6aaedd66-bcd8-467c-8729-ee499e5b7752 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:50.318644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6aaedd66-bcd8-467c-8729-ee499e5b7752 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:50.319073 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6aaedd66-bcd8-467c-8729-ee499e5b7752 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:50.445819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6aaedd66-bcd8-467c-8729-ee499e5b7752 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:50.453874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6aaedd66-bcd8-467c-8729-ee499e5b7752 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1722 microversion: 2.1 time: 0.149149 Aug 22 12:50:50.454469 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 231/467] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:50 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:51.476827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e767dacb-77da-456d-b392-2764e5238108 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:51.477493 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e767dacb-77da-456d-b392-2764e5238108 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:51.486464 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e767dacb-77da-456d-b392-2764e5238108 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:51.486957 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e767dacb-77da-456d-b392-2764e5238108 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:51.487398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e767dacb-77da-456d-b392-2764e5238108 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:51.488191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e767dacb-77da-456d-b392-2764e5238108 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:51.488573 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e767dacb-77da-456d-b392-2764e5238108 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:51.489001 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e767dacb-77da-456d-b392-2764e5238108 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:51.622682 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e767dacb-77da-456d-b392-2764e5238108 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:51.630875 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e767dacb-77da-456d-b392-2764e5238108 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1722 microversion: 2.1 time: 0.159179 Aug 22 12:50:51.631467 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 237/468] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:51 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:52.652066 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d5e5df68-bba6-41a8-80c9-fca5a729dca8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:52.652585 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d5e5df68-bba6-41a8-80c9-fca5a729dca8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:52.658946 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d5e5df68-bba6-41a8-80c9-fca5a729dca8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:52.659434 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d5e5df68-bba6-41a8-80c9-fca5a729dca8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:52.659869 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d5e5df68-bba6-41a8-80c9-fca5a729dca8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:52.660565 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d5e5df68-bba6-41a8-80c9-fca5a729dca8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:52.661018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d5e5df68-bba6-41a8-80c9-fca5a729dca8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:52.661481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d5e5df68-bba6-41a8-80c9-fca5a729dca8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:52.789124 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d5e5df68-bba6-41a8-80c9-fca5a729dca8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:52.797185 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d5e5df68-bba6-41a8-80c9-fca5a729dca8 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1728 microversion: 2.1 time: 0.149040 Aug 22 12:50:52.797741 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 232/469] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:50:52 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:52.817847 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ad1a3cd6-23bb-4b1b-be66-2c60c1ff0305 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:52.818392 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ad1a3cd6-23bb-4b1b-be66-2c60c1ff0305 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:52.824627 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad1a3cd6-23bb-4b1b-be66-2c60c1ff0305 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:52.825660 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad1a3cd6-23bb-4b1b-be66-2c60c1ff0305 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:52.826099 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad1a3cd6-23bb-4b1b-be66-2c60c1ff0305 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:52.826807 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad1a3cd6-23bb-4b1b-be66-2c60c1ff0305 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:52.827260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad1a3cd6-23bb-4b1b-be66-2c60c1ff0305 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:52.827679 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad1a3cd6-23bb-4b1b-be66-2c60c1ff0305 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:52.901236 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ad1a3cd6-23bb-4b1b-be66-2c60c1ff0305 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087096 Aug 22 12:50:52.901830 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 238/470] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 22 12:50:52 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:50:53.335326 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-06609f7f-c527-4b32-80c5-a5b7124ee7b1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:53.335852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-06609f7f-c527-4b32-80c5-a5b7124ee7b1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:53.342152 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06609f7f-c527-4b32-80c5-a5b7124ee7b1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:53.342673 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06609f7f-c527-4b32-80c5-a5b7124ee7b1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:53.343108 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06609f7f-c527-4b32-80c5-a5b7124ee7b1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:53.343803 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06609f7f-c527-4b32-80c5-a5b7124ee7b1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:53.344337 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06609f7f-c527-4b32-80c5-a5b7124ee7b1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:53.344763 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06609f7f-c527-4b32-80c5-a5b7124ee7b1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:53.375322 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-06609f7f-c527-4b32-80c5-a5b7124ee7b1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments/0c5b44a4-eedb-44e1-807c-fbe04e2075e4" status: 200 len: 194 microversion: 2.20 time: 0.043874 Aug 22 12:50:53.375894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 233/471] 10.222.0.15 () {60 vars in 1454 bytes} [Mon Aug 22 12:50:53 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments/0c5b44a4-eedb-44e1-807c-fbe04e2075e4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 12:50:53.442105 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f3b26467-35b5-434e-84d8-59f31cb51c7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:53.442630 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f3b26467-35b5-434e-84d8-59f31cb51c7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:53.448522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3b26467-35b5-434e-84d8-59f31cb51c7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:53.449009 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3b26467-35b5-434e-84d8-59f31cb51c7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:53.449495 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3b26467-35b5-434e-84d8-59f31cb51c7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:53.450239 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3b26467-35b5-434e-84d8-59f31cb51c7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:53.450694 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3b26467-35b5-434e-84d8-59f31cb51c7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:53.451123 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3b26467-35b5-434e-84d8-59f31cb51c7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:53.579415 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-f3b26467-35b5-434e-84d8-59f31cb51c7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lazy-loading 'services' on Instance uuid 4e060778-7e35-44e9-99f4-f2fb64f07928 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:50:53.891565 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f3b26467-35b5-434e-84d8-59f31cb51c7f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments/0c5b44a4-eedb-44e1-807c-fbe04e2075e4" status: 202 len: 0 microversion: 2.20 time: 0.453233 Aug 22 12:50:53.892378 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 239/472] 10.222.0.15 () {60 vars in 1457 bytes} [Mon Aug 22 12:50:53 2022] DELETE /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments/0c5b44a4-eedb-44e1-807c-fbe04e2075e4 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:50:53.900810 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ea554986-2a1a-411e-9ef1-349265c2b827 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:53.903611 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ea554986-2a1a-411e-9ef1-349265c2b827 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:53.910392 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea554986-2a1a-411e-9ef1-349265c2b827 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:53.910877 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea554986-2a1a-411e-9ef1-349265c2b827 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:53.911310 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea554986-2a1a-411e-9ef1-349265c2b827 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:53.912052 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea554986-2a1a-411e-9ef1-349265c2b827 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:53.912456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea554986-2a1a-411e-9ef1-349265c2b827 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:53.912874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ea554986-2a1a-411e-9ef1-349265c2b827 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:53.945136 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ea554986-2a1a-411e-9ef1-349265c2b827 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048057 Aug 22 12:50:53.947525 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 234/473] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 22 12:50:53 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 12:50:54.029396 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-8df46b92-3aab-4558-a1a7-331906f4314e req-6e99dd88-c417-462c-a2e3-bcb22c9985c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e67844-4079-4ba2-8edd-5c5023f9d4d4", "tag": "613e8f21-6d47-446a-84a6-33a7a6307506"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:50:54.048704 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-8df46b92-3aab-4558-a1a7-331906f4314e req-6e99dd88-c417-462c-a2e3-bcb22c9985c3 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:54.049198 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-8df46b92-3aab-4558-a1a7-331906f4314e req-6e99dd88-c417-462c-a2e3-bcb22c9985c3 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:54.049628 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-8df46b92-3aab-4558-a1a7-331906f4314e req-6e99dd88-c417-462c-a2e3-bcb22c9985c3 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:54.062016 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-8df46b92-3aab-4558-a1a7-331906f4314e req-6e99dd88-c417-462c-a2e3-bcb22c9985c3 service nova] Creating event network-changed:613e8f21-6d47-446a-84a6-33a7a6307506 for instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 on hv-cinder-85083 Aug 22 12:50:54.068738 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-8df46b92-3aab-4558-a1a7-331906f4314e req-6e99dd88-c417-462c-a2e3-bcb22c9985c3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043840 Aug 22 12:50:54.072536 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 240/474] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:50:54.959936 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-09cc5a03-6bec-4b21-9f46-6f9f4263c374 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:54.962158 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-09cc5a03-6bec-4b21-9f46-6f9f4263c374 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:54.968559 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-09cc5a03-6bec-4b21-9f46-6f9f4263c374 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:54.969043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-09cc5a03-6bec-4b21-9f46-6f9f4263c374 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:54.969911 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-09cc5a03-6bec-4b21-9f46-6f9f4263c374 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:54.970222 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-09cc5a03-6bec-4b21-9f46-6f9f4263c374 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:54.970686 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-09cc5a03-6bec-4b21-9f46-6f9f4263c374 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:54.971107 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-09cc5a03-6bec-4b21-9f46-6f9f4263c374 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:55.002848 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-09cc5a03-6bec-4b21-9f46-6f9f4263c374 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047151 Aug 22 12:50:55.003628 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 235/475] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 22 12:50:54 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:50:56.015748 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-930e37d0-c1e1-4c95-9c08-7698a5f823d2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:56.017965 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-930e37d0-c1e1-4c95-9c08-7698a5f823d2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:56.024671 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-930e37d0-c1e1-4c95-9c08-7698a5f823d2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:56.025157 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-930e37d0-c1e1-4c95-9c08-7698a5f823d2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:56.025601 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-930e37d0-c1e1-4c95-9c08-7698a5f823d2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:56.026325 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-930e37d0-c1e1-4c95-9c08-7698a5f823d2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:56.026787 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-930e37d0-c1e1-4c95-9c08-7698a5f823d2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:56.027212 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-930e37d0-c1e1-4c95-9c08-7698a5f823d2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:56.056102 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-930e37d0-c1e1-4c95-9c08-7698a5f823d2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044821 Aug 22 12:50:56.056647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 241/476] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 22 12:50:56 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:50:56.082797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-c3e1a2ba-a315-42a8-b06a-3ebe772cda28 req-ffad09d7-5a93-4b35-aa93-a0cec87ce427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e67844-4079-4ba2-8edd-5c5023f9d4d4", "tag": "613e8f21-6d47-446a-84a6-33a7a6307506"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:50:56.092263 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c3e1a2ba-a315-42a8-b06a-3ebe772cda28 req-ffad09d7-5a93-4b35-aa93-a0cec87ce427 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:56.092743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c3e1a2ba-a315-42a8-b06a-3ebe772cda28 req-ffad09d7-5a93-4b35-aa93-a0cec87ce427 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:56.093165 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c3e1a2ba-a315-42a8-b06a-3ebe772cda28 req-ffad09d7-5a93-4b35-aa93-a0cec87ce427 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:56.104034 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-c3e1a2ba-a315-42a8-b06a-3ebe772cda28 req-ffad09d7-5a93-4b35-aa93-a0cec87ce427 service nova] Creating event network-changed:613e8f21-6d47-446a-84a6-33a7a6307506 for instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 on hv-cinder-85083 Aug 22 12:50:56.109779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-c3e1a2ba-a315-42a8-b06a-3ebe772cda28 req-ffad09d7-5a93-4b35-aa93-a0cec87ce427 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030661 Aug 22 12:50:56.110414 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 236/477] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:50:56.118677 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f231d214-63ef-4427-94f0-b16057e8bd37 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:56.119175 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f231d214-63ef-4427-94f0-b16057e8bd37 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:56.124975 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f231d214-63ef-4427-94f0-b16057e8bd37 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:56.125455 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f231d214-63ef-4427-94f0-b16057e8bd37 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:56.125887 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f231d214-63ef-4427-94f0-b16057e8bd37 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:56.126594 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f231d214-63ef-4427-94f0-b16057e8bd37 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:56.127047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f231d214-63ef-4427-94f0-b16057e8bd37 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:56.127468 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f231d214-63ef-4427-94f0-b16057e8bd37 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:56.152237 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f231d214-63ef-4427-94f0-b16057e8bd37 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:50:56.352386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:56.595072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f231d214-63ef-4427-94f0-b16057e8bd37 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 204 len: 0 microversion: 2.20 time: 0.479791 Aug 22 12:50:56.595585 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 242/478] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 22 12:50:56 2022] DELETE /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 12:50:56.604589 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:56.605366 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:56.612150 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:56.612709 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:56.613230 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:56.613987 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:56.614585 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:56.614976 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:56.742833 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:56.751737 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:56.753230 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:56.754423 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2d0a1227-7f30-4c5b-93ad-c3f85e052dd4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.154340 Aug 22 12:50:56.755026 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 237/479] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:56 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:50:57.779162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:57.779784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:57.786501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:57.786991 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:57.787429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:57.788123 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:57.788590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:57.789013 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:57.924069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:57.932264 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:57.933748 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:57.935399 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-4c04184e-3b71-491b-a54d-dd5923e5fee9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.161421 Aug 22 12:50:57.935948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 243/480] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:57 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:58.958906 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:50:58.959652 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:50:58.967093 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:58.967587 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:58.968025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:58.968769 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:58.969224 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:58.969654 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:59.105420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:59.113882 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:59.115421 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:50:59.116591 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-86589a30-f030-45d3-96ab-26b0bf677dc6 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1725 microversion: 2.20 time: 0.161764 Aug 22 12:50:59.117149 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 238/481] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:50:58 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:50:59.552505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-a28d7685-b7b2-4012-9eba-607a65ae06e6 req-cf9645e8-a636-41a6-9d9a-9d6d247c690b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e060778-7e35-44e9-99f4-f2fb64f07928", "name": "network-vif-deleted", "tag": "b8fb88da-a096-4c45-bd62-6606ee956319"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:50:59.562059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-a28d7685-b7b2-4012-9eba-607a65ae06e6 req-cf9645e8-a636-41a6-9d9a-9d6d247c690b service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:50:59.567442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-a28d7685-b7b2-4012-9eba-607a65ae06e6 req-cf9645e8-a636-41a6-9d9a-9d6d247c690b service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:50:59.567442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-a28d7685-b7b2-4012-9eba-607a65ae06e6 req-cf9645e8-a636-41a6-9d9a-9d6d247c690b service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:50:59.574785 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-a28d7685-b7b2-4012-9eba-607a65ae06e6 req-cf9645e8-a636-41a6-9d9a-9d6d247c690b service nova] Creating event network-vif-deleted:b8fb88da-a096-4c45-bd62-6606ee956319 for instance 4e060778-7e35-44e9-99f4-f2fb64f07928 on hv-cinder-85083 Aug 22 12:50:59.579962 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-a28d7685-b7b2-4012-9eba-607a65ae06e6 req-cf9645e8-a636-41a6-9d9a-9d6d247c690b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031714 Aug 22 12:50:59.580884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 244/482] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:51:00.143717 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:00.144963 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:00.152555 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:00.153697 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:00.154219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:00.155172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:00.155628 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:00.156057 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:00.192389 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:00.192868 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:00.193875 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:00.194370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lazy-loading 'fault' on Instance uuid 4e060778-7e35-44e9-99f4-f2fb64f07928 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:51:00.256523 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:00.274973 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:00.279141 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:00.281045 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8ec53de7-e6eb-4b1b-965d-a2f7204f7fcd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 200 len: 1372 microversion: 2.20 time: 0.144431 Aug 22 12:51:00.281839 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 239/483] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:00 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:01.306975 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:01.307594 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:01.310007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:01.314759 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:01.315236 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:01.315668 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:01.316420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:01.316875 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:01.317324 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:01.333261 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] HTTP exception thrown: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Request method failure captured: Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 HTTP/1.1 Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3rMcZSP9JUKenJrkwBoxOVJGH3juPapNOcsn6t91niRv_nTVY-ijKlWumABEAqVeIu_Y8XAzBGxnehumtXNvrsOVNBI9LXaAByOlvqX-XUccfbMeVqEqKvAz9zD8UAi7W3H1szQO5_PLJeUdohlE2_saLDATCAzuEIA3vLw5GSVZI8 Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:51:01.334895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/97408eeab80e45f9a27c405c23038f8c"}]}] Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 36a40c9d61174c38b007ba0a30fc95c3 Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:51:01.336408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '4e060778-7e35-44e9-99f4-f2fb64f07928'} Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:51:01.337298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:51:01.339784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:51:01.341279 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Returning 404 to user: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:51:01.341279 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b71ed0ec-7c5e-41ad-b514-e776225e4b6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 404 len: 111 microversion: 2.20 time: 0.034143 Aug 22 12:51:01.341279 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 245/484] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:01 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 12:51:01.345067 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4ef5a083-5e5e-4946-a45b-562088a4193f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '.version_select at 0x7f7659deca60>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:01.458428 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4ef5a083-5e5e-4946-a45b-562088a4193f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547492172" status: 204 len: 0 microversion: 2.20 time: 0.116974 Aug 22 12:51:01.459033 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 240/485] 10.222.0.15 () {60 vars in 1262 bytes} [Mon Aug 22 12:51:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547492172 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 12:51:02.277045 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7459e8f5-c9fa-4728-91e1-5477edfd9e6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Action: 'create', calling method: .version_select at 0x7f7659e75040>, body: {"keypair": {"name": "tempest-keypair-1365433334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSE2TMDmLsSKrV9uP1wc1HXF7UIGHnmjGqWWIW87x4GyfXM735oKVEdCeRfQNeSXOmk9BvVkntHOhIGAt5GN462zufPFtKQc+DwGShpcW4i8aUjMXr2oi2AkZgEjG+90Q=="}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:02.292985 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-7459e8f5-c9fa-4728-91e1-5477edfd9e6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Getting quotas for project 97408eeab80e45f9a27c405c23038f8c. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:51:02.297360 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-7459e8f5-c9fa-4728-91e1-5477edfd9e6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Getting quotas for user 36a40c9d61174c38b007ba0a30fc95c3 and project 97408eeab80e45f9a27c405c23038f8c. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:51:02.368995 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7459e8f5-c9fa-4728-91e1-5477edfd9e6b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.095849 Aug 22 12:51:02.369674 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 246/486] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Aug 22 12:51:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 22 12:51:04.488921 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-563629644", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "674b889e-bd8d-4c99-a4a1-55e76da1b696"}], "security_groups": [{"name": "tempest-securitygroup--1925368541"}], "key_name": "tempest-keypair-1365433334", "user_data": "}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:04.590904 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.network.neutron [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] validate_networks() for [('674b889e-bd8d-4c99-a4a1-55e76da1b696', None, None, None, None, None)] {{(pid=127810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:51:04.970987 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Flavor limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:51:04.971405 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Image limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:51:04.971874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Flavor pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:51:04.972276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Image pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:51:04.972721 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:51:04.982487 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:04.982962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:04.983448 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:04.984167 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:04.984614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:04.985033 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:05.002917 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Getting quotas for project 97408eeab80e45f9a27c405c23038f8c. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:51:05.006970 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Getting quotas for user 36a40c9d61174c38b007ba0a30fc95c3 and project 97408eeab80e45f9a27c405c23038f8c. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:51:05.017870 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Going to run 1 instances... {{(pid=127810) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:51:05.020129 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:51:05.142393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-53c07f66-76ba-49d7-b06e-a1f2834bb73e tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.658205 Aug 22 12:51:05.143279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 241/487] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Aug 22 12:51:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 12:51:05.155239 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-cb45a980-34bb-4481-9bc8-9f76fbf7ebbd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:05.155831 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-cb45a980-34bb-4481-9bc8-9f76fbf7ebbd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:05.219661 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-cb45a980-34bb-4481-9bc8-9f76fbf7ebbd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:05.229221 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-cb45a980-34bb-4481-9bc8-9f76fbf7ebbd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:05.232207 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-cb45a980-34bb-4481-9bc8-9f76fbf7ebbd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:05.233338 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-cb45a980-34bb-4481-9bc8-9f76fbf7ebbd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1281 microversion: 2.20 time: 0.083097 Aug 22 12:51:05.233839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 247/488] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:05 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:06.255724 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:06.256369 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:06.263215 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:06.263708 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:06.264156 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:06.264847 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:06.265317 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:06.265724 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:06.330723 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:06.338746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:06.340250 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:06.341316 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3a6e86d5-b62c-41e5-ba2e-048263be6f5b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1285 microversion: 2.20 time: 0.089489 Aug 22 12:51:06.341868 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 242/489] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:06 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:07.364044 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:07.364754 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:07.371739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:07.372231 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:07.372670 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:07.373364 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:07.373819 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:07.374271 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:07.434230 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:07.442416 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:07.447358 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:07.447358 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8b16792a-5f6c-4627-885a-9406338c73c0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1333 microversion: 2.20 time: 0.084842 Aug 22 12:51:07.447358 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 248/490] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:07 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:08.468690 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:08.469311 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:08.475985 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:08.476476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:08.476912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:08.477610 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:08.478493 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:08.478937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:08.607066 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:08.609468 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=100 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:08.616107 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:08.617611 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:08.618813 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-669ec3ec-914b-4a0b-8857-b0bac6f0c0aa tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1407 microversion: 2.20 time: 0.154611 Aug 22 12:51:08.621533 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 243/491] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:08 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:09.274110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-680762a6-cb25-499d-ba2a-153cf52ec14a req-a7f6d471-59ba-4b43-a3c8-8e18bef807d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046710c4-dec2-4279-ab3f-297f3b5ba849", "tag": "36a57df9-56c9-4cce-82c6-813a9eb66d52"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:09.287595 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-680762a6-cb25-499d-ba2a-153cf52ec14a req-a7f6d471-59ba-4b43-a3c8-8e18bef807d7 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:09.288587 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-680762a6-cb25-499d-ba2a-153cf52ec14a req-a7f6d471-59ba-4b43-a3c8-8e18bef807d7 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:09.289681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-680762a6-cb25-499d-ba2a-153cf52ec14a req-a7f6d471-59ba-4b43-a3c8-8e18bef807d7 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:09.300583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-680762a6-cb25-499d-ba2a-153cf52ec14a req-a7f6d471-59ba-4b43-a3c8-8e18bef807d7 service nova] Creating event network-changed:36a57df9-56c9-4cce-82c6-813a9eb66d52 for instance 046710c4-dec2-4279-ab3f-297f3b5ba849 on hv-cinder-85083 Aug 22 12:51:09.305444 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-680762a6-cb25-499d-ba2a-153cf52ec14a req-a7f6d471-59ba-4b43-a3c8-8e18bef807d7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035081 Aug 22 12:51:09.306036 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 249/492] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:51:09.641831 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:09.642476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:09.649030 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:09.649520 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:09.649990 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:09.650796 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:09.651254 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:09.651684 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:09.785278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:09.793574 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:09.795212 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:09.796320 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-773f3625-e375-465c-b8ce-be313b22ebbc tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1407 microversion: 2.20 time: 0.159385 Aug 22 12:51:09.796879 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 244/493] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:09 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:10.819851 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:10.820551 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:10.827162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:10.827648 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:10.828087 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:10.828780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:10.829243 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:10.829668 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:10.955857 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:10.963954 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:10.966135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:10.967264 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-85e1e5e8-d299-4eeb-9940-15a9e6b49f46 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1407 microversion: 2.20 time: 0.152204 Aug 22 12:51:10.967818 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 250/494] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:10 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:11.989024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:11.989624 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:11.997562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:11.997562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:11.998314 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:11.999018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:11.999473 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:11.999901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:12.134102 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:12.142854 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:12.144335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:12.145468 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-bb35f788-9e00-41c4-b79c-89c1bf76855c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1407 microversion: 2.20 time: 0.160352 Aug 22 12:51:12.146041 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 245/495] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:11 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:13.168043 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:13.168978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:13.175123 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:13.175610 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:13.176045 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:13.176732 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:13.177195 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:13.177621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:13.311674 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:13.319745 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:13.321282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:13.322403 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2d9b64db-91d6-4009-9d95-4bad190545a1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1407 microversion: 2.20 time: 0.158795 Aug 22 12:51:13.322955 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 251/496] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:13 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:13.986094 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-5c833419-144f-4103-9c55-fa89004a6157 req-3e3fa721-d1bf-4208-83de-2ba30a179ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046710c4-dec2-4279-ab3f-297f3b5ba849", "name": "network-vif-plugged", "status": "completed", "tag": "36a57df9-56c9-4cce-82c6-813a9eb66d52"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:13.991396 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:13.996394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-5c833419-144f-4103-9c55-fa89004a6157 req-3e3fa721-d1bf-4208-83de-2ba30a179ee8 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:13.997523 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-5c833419-144f-4103-9c55-fa89004a6157 req-3e3fa721-d1bf-4208-83de-2ba30a179ee8 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:13.997959 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-5c833419-144f-4103-9c55-fa89004a6157 req-3e3fa721-d1bf-4208-83de-2ba30a179ee8 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:14.008535 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-5c833419-144f-4103-9c55-fa89004a6157 req-3e3fa721-d1bf-4208-83de-2ba30a179ee8 service nova] Creating event network-vif-plugged:36a57df9-56c9-4cce-82c6-813a9eb66d52 for instance 046710c4-dec2-4279-ab3f-297f3b5ba849 on hv-cinder-85083 Aug 22 12:51:14.013408 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-5c833419-144f-4103-9c55-fa89004a6157 req-3e3fa721-d1bf-4208-83de-2ba30a179ee8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030929 Aug 22 12:51:14.018709 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 246/497] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:51:14.345130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:14.345867 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:14.352394 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:14.353135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:14.353587 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:14.354305 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:14.354770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:14.355187 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:14.486962 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:14.497188 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:14.498747 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:14.499865 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f179262e-6aea-4cc8-927f-e1cc672917b3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1407 microversion: 2.20 time: 0.159270 Aug 22 12:51:14.500417 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 252/498] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:14 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:15.520595 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:15.521376 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=6 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:15.525514 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:15.526153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:15.533877 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:15.534409 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:15.534847 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:15.535578 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:15.536033 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:15.536460 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:15.668618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:15.676927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:15.678603 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:15.679547 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-186b74bc-4401-40f5-9ffe-9475330a4f43 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1407 microversion: 2.20 time: 0.160402 Aug 22 12:51:15.680100 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 247/499] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:15 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:16.703553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:16.704126 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:16.706052 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=6 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:16.711217 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:16.711703 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:16.712138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:16.712836 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:16.713290 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:16.713815 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:16.844767 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:16.852992 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:16.854549 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:16.855695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d001de95-0aa3-42b2-bc31-bec95652c30a tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1599 microversion: 2.20 time: 0.156660 Aug 22 12:51:16.856243 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 253/500] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:16 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:51:16.877106 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-90366fc3-acba-4f05-be28-670079f2848f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:16.877635 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-90366fc3-acba-4f05-be28-670079f2848f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:16.883969 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90366fc3-acba-4f05-be28-670079f2848f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:16.884450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90366fc3-acba-4f05-be28-670079f2848f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:16.884885 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90366fc3-acba-4f05-be28-670079f2848f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:16.885572 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90366fc3-acba-4f05-be28-670079f2848f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:16.886026 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90366fc3-acba-4f05-be28-670079f2848f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:16.886489 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-90366fc3-acba-4f05-be28-670079f2848f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:16.964629 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-90366fc3-acba-4f05-be28-670079f2848f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091343 Aug 22 12:51:16.965223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 248/501] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Aug 22 12:51:16 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:51:18.145254 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-d787273b-02c7-4e64-8bfa-02597c5622ea req-1e93e7ae-1ae9-44ee-9e4f-978004ec31e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046710c4-dec2-4279-ab3f-297f3b5ba849", "tag": "36a57df9-56c9-4cce-82c6-813a9eb66d52"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:18.155140 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d787273b-02c7-4e64-8bfa-02597c5622ea req-1e93e7ae-1ae9-44ee-9e4f-978004ec31e9 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:18.155719 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d787273b-02c7-4e64-8bfa-02597c5622ea req-1e93e7ae-1ae9-44ee-9e4f-978004ec31e9 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:18.156807 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d787273b-02c7-4e64-8bfa-02597c5622ea req-1e93e7ae-1ae9-44ee-9e4f-978004ec31e9 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:18.167711 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-d787273b-02c7-4e64-8bfa-02597c5622ea req-1e93e7ae-1ae9-44ee-9e4f-978004ec31e9 service nova] Creating event network-changed:36a57df9-56c9-4cce-82c6-813a9eb66d52 for instance 046710c4-dec2-4279-ab3f-297f3b5ba849 on hv-cinder-85083 Aug 22 12:51:18.172602 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-d787273b-02c7-4e64-8bfa-02597c5622ea req-1e93e7ae-1ae9-44ee-9e4f-978004ec31e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030981 Aug 22 12:51:18.173358 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 254/502] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:51:22.001545 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2444bbcd-6d30-4d33-8497-7dc9ad10a039 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:22.003923 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2444bbcd-6d30-4d33-8497-7dc9ad10a039 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:22.009802 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2444bbcd-6d30-4d33-8497-7dc9ad10a039 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:22.010322 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2444bbcd-6d30-4d33-8497-7dc9ad10a039 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:22.010759 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2444bbcd-6d30-4d33-8497-7dc9ad10a039 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:22.011448 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2444bbcd-6d30-4d33-8497-7dc9ad10a039 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:22.011904 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2444bbcd-6d30-4d33-8497-7dc9ad10a039 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:22.012333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2444bbcd-6d30-4d33-8497-7dc9ad10a039 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:22.043208 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2444bbcd-6d30-4d33-8497-7dc9ad10a039 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046182 Aug 22 12:51:22.043744 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 249/503] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:51:21 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 12:51:22.109420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-625531bb-1f27-434f-9fcf-dd20da8393ab tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:22.110020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-625531bb-1f27-434f-9fcf-dd20da8393ab tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:22.116009 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-625531bb-1f27-434f-9fcf-dd20da8393ab tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:22.116488 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-625531bb-1f27-434f-9fcf-dd20da8393ab tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:22.116922 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-625531bb-1f27-434f-9fcf-dd20da8393ab tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:22.117607 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-625531bb-1f27-434f-9fcf-dd20da8393ab tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:22.118065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-625531bb-1f27-434f-9fcf-dd20da8393ab tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:22.118515 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-625531bb-1f27-434f-9fcf-dd20da8393ab tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:22.142532 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-625531bb-1f27-434f-9fcf-dd20da8393ab tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:51:22.441404 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-625531bb-1f27-434f-9fcf-dd20da8393ab tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "DELETE /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 204 len: 0 microversion: 2.1 time: 0.336413 Aug 22 12:51:22.442022 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 255/504] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:51:22 2022] DELETE /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:51:22.450134 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3caa3831-0b18-4f00-8664-facdbf5b30f0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:22.450916 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3caa3831-0b18-4f00-8664-facdbf5b30f0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:22.457410 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3caa3831-0b18-4f00-8664-facdbf5b30f0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:22.457919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3caa3831-0b18-4f00-8664-facdbf5b30f0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:22.458376 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3caa3831-0b18-4f00-8664-facdbf5b30f0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:22.459058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3caa3831-0b18-4f00-8664-facdbf5b30f0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:22.459511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3caa3831-0b18-4f00-8664-facdbf5b30f0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:22.459932 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3caa3831-0b18-4f00-8664-facdbf5b30f0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:22.595409 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3caa3831-0b18-4f00-8664-facdbf5b30f0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:22.603393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3caa3831-0b18-4f00-8664-facdbf5b30f0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1674 microversion: 2.1 time: 0.157066 Aug 22 12:51:22.603963 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 250/505] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:22 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:23.626293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-713297de-6de6-462e-acac-8cbeb577519c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:23.626913 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-713297de-6de6-462e-acac-8cbeb577519c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:23.633220 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-713297de-6de6-462e-acac-8cbeb577519c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:23.633750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-713297de-6de6-462e-acac-8cbeb577519c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:23.634192 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-713297de-6de6-462e-acac-8cbeb577519c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:23.634884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-713297de-6de6-462e-acac-8cbeb577519c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:23.635334 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-713297de-6de6-462e-acac-8cbeb577519c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:23.635751 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-713297de-6de6-462e-acac-8cbeb577519c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:23.763379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-713297de-6de6-462e-acac-8cbeb577519c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:23.771107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-713297de-6de6-462e-acac-8cbeb577519c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1674 microversion: 2.1 time: 0.149924 Aug 22 12:51:23.771664 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 256/506] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:23 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:24.791941 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d810f801-89e6-4e7a-a9be-5906954aa2bd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:24.792559 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d810f801-89e6-4e7a-a9be-5906954aa2bd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:24.799680 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d810f801-89e6-4e7a-a9be-5906954aa2bd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:24.800183 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d810f801-89e6-4e7a-a9be-5906954aa2bd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:24.804212 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d810f801-89e6-4e7a-a9be-5906954aa2bd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:24.804212 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d810f801-89e6-4e7a-a9be-5906954aa2bd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:24.804212 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d810f801-89e6-4e7a-a9be-5906954aa2bd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:24.804212 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d810f801-89e6-4e7a-a9be-5906954aa2bd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:24.933115 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d810f801-89e6-4e7a-a9be-5906954aa2bd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:24.941795 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d810f801-89e6-4e7a-a9be-5906954aa2bd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1674 microversion: 2.1 time: 0.153651 Aug 22 12:51:24.942411 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 251/507] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:24 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:25.732522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-3df346d6-6fee-4838-9290-db9a4cb6fd9d req-b999bfd4-5774-4191-a5fc-4528cd1b3ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48cd5dbe-4358-40f8-9515-87434787eca4", "name": "network-vif-deleted", "tag": "5e8ad75e-fce7-4867-9eae-2924ebf24649"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:25.743874 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-3df346d6-6fee-4838-9290-db9a4cb6fd9d req-b999bfd4-5774-4191-a5fc-4528cd1b3ce8 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:25.744376 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-3df346d6-6fee-4838-9290-db9a4cb6fd9d req-b999bfd4-5774-4191-a5fc-4528cd1b3ce8 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:25.744874 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-3df346d6-6fee-4838-9290-db9a4cb6fd9d req-b999bfd4-5774-4191-a5fc-4528cd1b3ce8 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:25.756372 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-3df346d6-6fee-4838-9290-db9a4cb6fd9d req-b999bfd4-5774-4191-a5fc-4528cd1b3ce8 service nova] Creating event network-vif-deleted:5e8ad75e-fce7-4867-9eae-2924ebf24649 for instance 48cd5dbe-4358-40f8-9515-87434787eca4 on hv-cinder-85083 Aug 22 12:51:25.761382 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-3df346d6-6fee-4838-9290-db9a4cb6fd9d req-b999bfd4-5774-4191-a5fc-4528cd1b3ce8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 Aug 22 12:51:25.762151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 257/508] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:51:25.963828 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-47cb7af3-c938-4c85-bec6-4536a9640560 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:25.965202 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-47cb7af3-c938-4c85-bec6-4536a9640560 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:25.971751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-47cb7af3-c938-4c85-bec6-4536a9640560 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:25.972456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-47cb7af3-c938-4c85-bec6-4536a9640560 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:25.976489 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-47cb7af3-c938-4c85-bec6-4536a9640560 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:25.976489 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-47cb7af3-c938-4c85-bec6-4536a9640560 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:25.976489 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-47cb7af3-c938-4c85-bec6-4536a9640560 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:25.976489 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-47cb7af3-c938-4c85-bec6-4536a9640560 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:26.040573 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-47cb7af3-c938-4c85-bec6-4536a9640560 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:26.048294 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-47cb7af3-c938-4c85-bec6-4536a9640560 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 200 len: 1322 microversion: 2.1 time: 0.088547 Aug 22 12:51:26.048854 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 252/509] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:25 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 1322 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:26.445525 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-279d35d7-f7a8-428f-be64-ff07d6b27335 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:26.446113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-279d35d7-f7a8-428f-be64-ff07d6b27335 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:26.452538 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-279d35d7-f7a8-428f-be64-ff07d6b27335 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:26.453034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-279d35d7-f7a8-428f-be64-ff07d6b27335 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:26.453478 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-279d35d7-f7a8-428f-be64-ff07d6b27335 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:26.454169 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-279d35d7-f7a8-428f-be64-ff07d6b27335 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:26.454656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-279d35d7-f7a8-428f-be64-ff07d6b27335 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:26.455080 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-279d35d7-f7a8-428f-be64-ff07d6b27335 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:26.539232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-279d35d7-f7a8-428f-be64-ff07d6b27335 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lazy-loading 'services' on Instance uuid 59e67844-4079-4ba2-8edd-5c5023f9d4d4 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:51:26.842519 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-279d35d7-f7a8-428f-be64-ff07d6b27335 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments/4a345e3b-f8b5-404d-97f2-df4fa5001a70" status: 202 len: 0 microversion: 2.1 time: 0.401230 Aug 22 12:51:26.845091 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 258/510] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 12:51:26 2022] DELETE /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments/4a345e3b-f8b5-404d-97f2-df4fa5001a70 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:51:26.852193 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-441fb128-ffaa-49a4-bdf9-b0f97e59518f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:26.854734 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-441fb128-ffaa-49a4-bdf9-b0f97e59518f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:26.861503 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-441fb128-ffaa-49a4-bdf9-b0f97e59518f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:26.862285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-441fb128-ffaa-49a4-bdf9-b0f97e59518f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:26.862730 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-441fb128-ffaa-49a4-bdf9-b0f97e59518f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:26.863471 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-441fb128-ffaa-49a4-bdf9-b0f97e59518f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:26.863933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-441fb128-ffaa-49a4-bdf9-b0f97e59518f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:26.864355 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-441fb128-ffaa-49a4-bdf9-b0f97e59518f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:26.893078 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-441fb128-ffaa-49a4-bdf9-b0f97e59518f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044890 Aug 22 12:51:26.893636 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 253/511] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:51:26 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:51:27.069549 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:27.070289 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:27.076516 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:27.077214 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:27.077651 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:27.078904 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:27.079365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:27.079850 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:27.093044 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] HTTP exception thrown: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Request method failure captured: Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 HTTP/1.1 Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3rM2waID04oKd1_4SuYiX9kYL54gjmpSQ7QFoGMOisE65PmeEAqf2V_1PMo3pMQ00SvrQRF5gRcaDw8yps9dTrOazM28FTuGUwXr31k19jt3vd_jTX75MTKt2b91FwXtaazS6kDjhd4AaWZ1nXqpOQFpj-jv04FUxGJY8unaf4No4A Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:51:27.095260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2e81d9adcb6477aa19c0cbacca01351"}]}] Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 5b1db5be49014d2cba63cdee9df5b1d0 Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:51:27.096620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '48cd5dbe-4358-40f8-9515-87434787eca4'} Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:51:27.097461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:51:27.098780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:51:27.100004 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Returning 404 to user: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:51:27.100004 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bc8ee4d5-df73-4ef1-b6f1-a1dc6adbb31c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 404 len: 111 microversion: 2.1 time: 0.031559 Aug 22 12:51:27.100004 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 259/512] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:27 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:51:27.106277 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4f61c384-cbe7-44c8-8e4c-9578c0426657 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '.version_select at 0x7f7659cf5040>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:27.222961 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4f61c384-cbe7-44c8-8e4c-9578c0426657 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-682175871" status: 202 len: 0 microversion: 2.1 time: 0.121120 Aug 22 12:51:27.223494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 254/513] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Aug 22 12:51:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-682175871 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:51:27.905269 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bff47f10-13b8-4f60-8354-a01957fdbeee tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:27.908182 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bff47f10-13b8-4f60-8354-a01957fdbeee tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:27.914561 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bff47f10-13b8-4f60-8354-a01957fdbeee tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:27.915048 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bff47f10-13b8-4f60-8354-a01957fdbeee tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:27.915480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bff47f10-13b8-4f60-8354-a01957fdbeee tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:27.916172 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bff47f10-13b8-4f60-8354-a01957fdbeee tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:27.916626 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bff47f10-13b8-4f60-8354-a01957fdbeee tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:27.917206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bff47f10-13b8-4f60-8354-a01957fdbeee tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:27.924104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=78,nova_cell1:UPDATE=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:27.950723 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bff47f10-13b8-4f60-8354-a01957fdbeee tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049411 Aug 22 12:51:27.951284 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 260/514] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:51:27 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:51:28.293330 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-24c4bf7e-48df-466c-8c3e-3a6080a21e15 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Action: 'create', calling method: .version_select at 0x7f7659dec790>, body: {"keypair": {"name": "tempest-keypair-1882659064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5kPy1gU1684qK+Sx1kxxlUFf+9hk7YN1/1dKR01k1uEY5AYtnh0Cnye429ihZk1Z6hqXpjtWXVmbosaN7qOXjz+g4Lqx/xTqM7nPf9gHUqrOVkt3Fqgz8UpvlpBFvcsg=="}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:28.309152 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-24c4bf7e-48df-466c-8c3e-3a6080a21e15 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Getting quotas for project d2e81d9adcb6477aa19c0cbacca01351. Resources: {'key_pairs'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:51:28.313537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-24c4bf7e-48df-466c-8c3e-3a6080a21e15 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Getting quotas for user 5b1db5be49014d2cba63cdee9df5b1d0 and project d2e81d9adcb6477aa19c0cbacca01351. Resources: {'key_pairs'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:51:28.405045 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-24c4bf7e-48df-466c-8c3e-3a6080a21e15 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114205 Aug 22 12:51:28.405662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 255/515] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 22 12:51:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:51:28.964099 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-739d3931-b4d1-4c58-b435-6c9a22d645b5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:28.966424 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-739d3931-b4d1-4c58-b435-6c9a22d645b5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:28.974950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-739d3931-b4d1-4c58-b435-6c9a22d645b5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:28.975442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-739d3931-b4d1-4c58-b435-6c9a22d645b5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:28.976028 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-739d3931-b4d1-4c58-b435-6c9a22d645b5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:28.976662 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-739d3931-b4d1-4c58-b435-6c9a22d645b5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:28.977119 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-739d3931-b4d1-4c58-b435-6c9a22d645b5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:28.977539 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-739d3931-b4d1-4c58-b435-6c9a22d645b5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:29.007496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-739d3931-b4d1-4c58-b435-6c9a22d645b5 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047843 Aug 22 12:51:29.008045 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 261/516] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:51:28 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 12:51:29.087357 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-671da6b5-0156-401b-b39d-879b7e1d4f4a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:29.087843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-671da6b5-0156-401b-b39d-879b7e1d4f4a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:29.094306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-671da6b5-0156-401b-b39d-879b7e1d4f4a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:29.094306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-671da6b5-0156-401b-b39d-879b7e1d4f4a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:29.094682 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-671da6b5-0156-401b-b39d-879b7e1d4f4a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:29.095373 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-671da6b5-0156-401b-b39d-879b7e1d4f4a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:29.095825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-671da6b5-0156-401b-b39d-879b7e1d4f4a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:29.096259 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-671da6b5-0156-401b-b39d-879b7e1d4f4a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:29.120279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-671da6b5-0156-401b-b39d-879b7e1d4f4a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Going to try to terminate instance {{(pid=127810) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:51:29.360669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-671da6b5-0156-401b-b39d-879b7e1d4f4a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 204 len: 0 microversion: 2.1 time: 0.276255 Aug 22 12:51:29.362138 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 256/517] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:51:29 2022] DELETE /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:51:29.369906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3daa4981-3e94-4b99-82aa-128063734b9f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:29.370580 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-3daa4981-3e94-4b99-82aa-128063734b9f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:29.377821 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3daa4981-3e94-4b99-82aa-128063734b9f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:29.378327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3daa4981-3e94-4b99-82aa-128063734b9f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:29.378762 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3daa4981-3e94-4b99-82aa-128063734b9f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:29.379529 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3daa4981-3e94-4b99-82aa-128063734b9f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:29.379985 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3daa4981-3e94-4b99-82aa-128063734b9f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:29.380405 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3daa4981-3e94-4b99-82aa-128063734b9f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:29.509486 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3daa4981-3e94-4b99-82aa-128063734b9f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:29.517183 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-3daa4981-3e94-4b99-82aa-128063734b9f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1688 microversion: 2.1 time: 0.151451 Aug 22 12:51:29.517785 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 262/518] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:29 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:30.538916 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-266b7207-59f2-43e3-81cc-eb6031dc4b53 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:30.539617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-266b7207-59f2-43e3-81cc-eb6031dc4b53 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:30.547517 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-266b7207-59f2-43e3-81cc-eb6031dc4b53 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:30.548045 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-266b7207-59f2-43e3-81cc-eb6031dc4b53 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:30.548473 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-266b7207-59f2-43e3-81cc-eb6031dc4b53 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:30.549170 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-266b7207-59f2-43e3-81cc-eb6031dc4b53 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:30.549622 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-266b7207-59f2-43e3-81cc-eb6031dc4b53 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:30.550048 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-266b7207-59f2-43e3-81cc-eb6031dc4b53 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:30.581276 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1015043543", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49d8665d-f9be-4c27-9fb3-77166a6f137c"}], "security_groups": [{"name": "tempest-securitygroup--1097013020"}], "key_name": "tempest-keypair-1882659064", "user_data": "}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:30.714966 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-266b7207-59f2-43e3-81cc-eb6031dc4b53 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:30.716851 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] validate_networks() for [('49d8665d-f9be-4c27-9fb3-77166a6f137c', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:51:30.726760 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-266b7207-59f2-43e3-81cc-eb6031dc4b53 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1688 microversion: 2.1 time: 0.191211 Aug 22 12:51:30.726760 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 257/519] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:30 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:31.079866 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:51:31.080287 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:51:31.080792 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:51:31.081201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:51:31.081614 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:51:31.090566 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:31.091047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:31.091481 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:31.092213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:31.092668 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:31.093093 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:31.110271 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Getting quotas for project d2e81d9adcb6477aa19c0cbacca01351. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:51:31.114395 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Getting quotas for user 5b1db5be49014d2cba63cdee9df5b1d0 and project d2e81d9adcb6477aa19c0cbacca01351. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:51:31.125693 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:51:31.127999 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:51:31.269683 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c65ff52f-ec20-44c8-8714-127c01cc0ed2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.692523 Aug 22 12:51:31.270340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 263/520] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:51:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 12:51:31.280982 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-095aca2c-78db-4f63-8e12-cf67d134a07a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:31.284799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-095aca2c-78db-4f63-8e12-cf67d134a07a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:31.342093 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-095aca2c-78db-4f63-8e12-cf67d134a07a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:31.349038 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-095aca2c-78db-4f63-8e12-cf67d134a07a tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1238 microversion: 2.1 time: 0.071833 Aug 22 12:51:31.349611 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 258/521] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:31 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:31.748987 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f3e59af4-08dc-44e7-a112-8b989e852cf6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:31.749643 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f3e59af4-08dc-44e7-a112-8b989e852cf6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:31.756846 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3e59af4-08dc-44e7-a112-8b989e852cf6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:31.757340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3e59af4-08dc-44e7-a112-8b989e852cf6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:31.757956 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3e59af4-08dc-44e7-a112-8b989e852cf6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:31.758745 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3e59af4-08dc-44e7-a112-8b989e852cf6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:31.759210 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3e59af4-08dc-44e7-a112-8b989e852cf6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:31.759718 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f3e59af4-08dc-44e7-a112-8b989e852cf6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:31.889558 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f3e59af4-08dc-44e7-a112-8b989e852cf6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:31.897230 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f3e59af4-08dc-44e7-a112-8b989e852cf6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1688 microversion: 2.1 time: 0.152642 Aug 22 12:51:31.897787 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 264/522] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:31 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:32.369612 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-06c3b695-7651-4325-81d7-3d90a2e69783 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:32.370265 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-06c3b695-7651-4325-81d7-3d90a2e69783 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:32.377908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06c3b695-7651-4325-81d7-3d90a2e69783 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:32.378527 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06c3b695-7651-4325-81d7-3d90a2e69783 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:32.378981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06c3b695-7651-4325-81d7-3d90a2e69783 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:32.379667 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06c3b695-7651-4325-81d7-3d90a2e69783 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:32.380119 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06c3b695-7651-4325-81d7-3d90a2e69783 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:32.380537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-06c3b695-7651-4325-81d7-3d90a2e69783 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:32.441285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-06c3b695-7651-4325-81d7-3d90a2e69783 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:32.448729 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-06c3b695-7651-4325-81d7-3d90a2e69783 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1242 microversion: 2.1 time: 0.082978 Aug 22 12:51:32.449290 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 259/523] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:32 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:32.918722 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bb740145-a9cf-44cb-a968-f571e61c8f48 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:32.919329 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bb740145-a9cf-44cb-a968-f571e61c8f48 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:32.921710 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:32.927534 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb740145-a9cf-44cb-a968-f571e61c8f48 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:32.928030 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb740145-a9cf-44cb-a968-f571e61c8f48 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:32.928469 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb740145-a9cf-44cb-a968-f571e61c8f48 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:32.929176 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb740145-a9cf-44cb-a968-f571e61c8f48 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:32.929636 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb740145-a9cf-44cb-a968-f571e61c8f48 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:32.930063 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb740145-a9cf-44cb-a968-f571e61c8f48 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:33.069714 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bb740145-a9cf-44cb-a968-f571e61c8f48 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:33.078658 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bb740145-a9cf-44cb-a968-f571e61c8f48 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1688 microversion: 2.1 time: 0.163211 Aug 22 12:51:33.079426 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 265/524] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:32 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:33.469321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2082f4d5-b818-450e-84b8-a421ebb98bd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:33.469977 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2082f4d5-b818-450e-84b8-a421ebb98bd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:33.476407 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2082f4d5-b818-450e-84b8-a421ebb98bd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:33.476890 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2082f4d5-b818-450e-84b8-a421ebb98bd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:33.477325 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2082f4d5-b818-450e-84b8-a421ebb98bd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:33.478313 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2082f4d5-b818-450e-84b8-a421ebb98bd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:33.478856 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2082f4d5-b818-450e-84b8-a421ebb98bd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:33.479285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2082f4d5-b818-450e-84b8-a421ebb98bd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:33.550548 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2082f4d5-b818-450e-84b8-a421ebb98bd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:33.553306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2082f4d5-b818-450e-84b8-a421ebb98bd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1290 microversion: 2.1 time: 0.087939 Aug 22 12:51:33.553957 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 260/525] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:33 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:51:33.819959 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-269f7ce8-e983-4f09-aede-cb8c99fee1d0 req-5ad8e85c-d535-4726-9e50-0855a68f9760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e67844-4079-4ba2-8edd-5c5023f9d4d4", "name": "network-vif-deleted", "tag": "613e8f21-6d47-446a-84a6-33a7a6307506"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:33.829529 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-269f7ce8-e983-4f09-aede-cb8c99fee1d0 req-5ad8e85c-d535-4726-9e50-0855a68f9760 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:33.830002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-269f7ce8-e983-4f09-aede-cb8c99fee1d0 req-5ad8e85c-d535-4726-9e50-0855a68f9760 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:33.830449 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-269f7ce8-e983-4f09-aede-cb8c99fee1d0 req-5ad8e85c-d535-4726-9e50-0855a68f9760 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:33.841292 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-269f7ce8-e983-4f09-aede-cb8c99fee1d0 req-5ad8e85c-d535-4726-9e50-0855a68f9760 service nova] Creating event network-vif-deleted:613e8f21-6d47-446a-84a6-33a7a6307506 for instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 on hv-cinder-85083 Aug 22 12:51:33.846978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-269f7ce8-e983-4f09-aede-cb8c99fee1d0 req-5ad8e85c-d535-4726-9e50-0855a68f9760 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032381 Aug 22 12:51:33.847565 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 266/526] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:51:34.099542 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:34.100433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:34.108151 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:34.109857 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:34.109857 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:34.110370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:34.110732 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:34.111569 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:34.155503 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:34.156821 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:34.157375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:34.157945 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lazy-loading 'fault' on Instance uuid 59e67844-4079-4ba2-8edd-5c5023f9d4d4 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:51:34.207781 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:34.215871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b3afb3d4-ff7b-469f-8d32-02bbb764e529 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 200 len: 1335 microversion: 2.1 time: 0.120056 Aug 22 12:51:34.216769 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 261/527] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:34 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:34.577113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9ad89a94-bb11-42b0-ab8a-9c8d4da0cb7d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:34.577819 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9ad89a94-bb11-42b0-ab8a-9c8d4da0cb7d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:34.585497 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ad89a94-bb11-42b0-ab8a-9c8d4da0cb7d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:34.585993 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ad89a94-bb11-42b0-ab8a-9c8d4da0cb7d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:34.586461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ad89a94-bb11-42b0-ab8a-9c8d4da0cb7d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:34.587202 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ad89a94-bb11-42b0-ab8a-9c8d4da0cb7d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:34.587829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ad89a94-bb11-42b0-ab8a-9c8d4da0cb7d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:34.588452 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ad89a94-bb11-42b0-ab8a-9c8d4da0cb7d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:34.668823 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-9ad89a94-bb11-42b0-ab8a-9c8d4da0cb7d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:34.676468 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9ad89a94-bb11-42b0-ab8a-9c8d4da0cb7d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1296 microversion: 2.1 time: 0.104797 Aug 22 12:51:34.677038 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 267/528] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:34 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:51:35.240518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:35.241128 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 59e67844-4079-4ba2-8edd-5c5023f9d4d4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:35.247509 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:35.248001 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:35.248439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:35.249141 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:35.249596 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:35.250021 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:35.264100 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] HTTP exception thrown: Instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 could not be found. Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Request method failure captured: Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 HTTP/1.1 Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rHTwMTo6zGt_ez_vmdEnfXSSDlW_ImyAeBjZj5lPt9LtxzxK-5VBTsf3eRd136OGLX0aofzvbz2KqrBKfOr6yVt5iXGUXXbBLQCzrCJRuuhXMl3GBJuSZzIjP1u4jmmlxE81HPMY7Casqzy1V5P9wc5vH205JPMnat-aavB0Eamzk Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 30bf0498eabd4d9988b2084c0b082fad Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:51:35.265761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30bf0498eabd4d9988b2084c0b082fad"}]}] Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 30bf0498eabd4d9988b2084c0b082fad Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-ServerRescueNegativeTestJSON-93198942-project Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 9767d18cf0944f16b45fff4214128c1a Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-93198942-project Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 could not be found. Aug 22 12:51:35.267104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '59e67844-4079-4ba2-8edd-5c5023f9d4d4'} Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 could not be found. Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:51:35.267872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 could not be found. Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 could not be found. Aug 22 12:51:35.269360 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:35.270719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Returning 404 to user: Instance 59e67844-4079-4ba2-8edd-5c5023f9d4d4 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:51:35.270719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7a23e34b-be91-4809-be19-b0a10c806a89 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4" status: 404 len: 111 microversion: 2.1 time: 0.030577 Aug 22 12:51:35.270719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 262/529] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:35 2022] GET /compute/v2.1/servers/59e67844-4079-4ba2-8edd-5c5023f9d4d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:51:35.275899 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f5f5e824-ceba-43b9-a7e8-97ef531460ed tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '.version_select at 0x7f7659e3ce50>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:35.377773 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f5f5e824-ceba-43b9-a7e8-97ef531460ed tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984327608" status: 202 len: 0 microversion: 2.1 time: 0.105408 Aug 22 12:51:35.378307 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 268/530] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 22 12:51:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984327608 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:51:35.697333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ec21f276-ee25-4d8f-87ac-ab0263c77fac tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:35.698062 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ec21f276-ee25-4d8f-87ac-ab0263c77fac tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:35.704564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec21f276-ee25-4d8f-87ac-ab0263c77fac tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:35.705052 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec21f276-ee25-4d8f-87ac-ab0263c77fac tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:35.705489 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec21f276-ee25-4d8f-87ac-ab0263c77fac tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:35.706197 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec21f276-ee25-4d8f-87ac-ab0263c77fac tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:35.706653 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec21f276-ee25-4d8f-87ac-ab0263c77fac tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:35.707081 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec21f276-ee25-4d8f-87ac-ab0263c77fac tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:35.709705 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:35.848464 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-e5ee1f0d-0151-49fb-a37a-9f76c4557fe9 req-86eb1c8a-06e9-4d4f-ae58-6032b41e7807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15568e81-a422-4316-a242-0d24c7360ad3", "tag": "e0fc1842-b3f1-41ad-8953-f931c2cca090"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:35.864225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-e5ee1f0d-0151-49fb-a37a-9f76c4557fe9 req-86eb1c8a-06e9-4d4f-ae58-6032b41e7807 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:35.867508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-e5ee1f0d-0151-49fb-a37a-9f76c4557fe9 req-86eb1c8a-06e9-4d4f-ae58-6032b41e7807 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:35.867508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-e5ee1f0d-0151-49fb-a37a-9f76c4557fe9 req-86eb1c8a-06e9-4d4f-ae58-6032b41e7807 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:35.876751 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-e5ee1f0d-0151-49fb-a37a-9f76c4557fe9 req-86eb1c8a-06e9-4d4f-ae58-6032b41e7807 service nova] Creating event network-changed:e0fc1842-b3f1-41ad-8953-f931c2cca090 for instance 15568e81-a422-4316-a242-0d24c7360ad3 on hv-cinder-85083 Aug 22 12:51:35.882451 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-e5ee1f0d-0151-49fb-a37a-9f76c4557fe9 req-86eb1c8a-06e9-4d4f-ae58-6032b41e7807 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047154 Aug 22 12:51:35.883275 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 269/531] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:51:35.906880 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ec21f276-ee25-4d8f-87ac-ab0263c77fac tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:35.918174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ec21f276-ee25-4d8f-87ac-ab0263c77fac tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1364 microversion: 2.1 time: 0.222468 Aug 22 12:51:35.918174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 263/532] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:35 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:36.937299 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-41c73fa2-863b-48ad-83c9-3523aa539dd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:36.938573 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-41c73fa2-863b-48ad-83c9-3523aa539dd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:36.945151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41c73fa2-863b-48ad-83c9-3523aa539dd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:36.945632 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41c73fa2-863b-48ad-83c9-3523aa539dd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:36.946066 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41c73fa2-863b-48ad-83c9-3523aa539dd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:36.946777 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41c73fa2-863b-48ad-83c9-3523aa539dd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:36.947231 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41c73fa2-863b-48ad-83c9-3523aa539dd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:36.947654 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41c73fa2-863b-48ad-83c9-3523aa539dd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:37.076909 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-41c73fa2-863b-48ad-83c9-3523aa539dd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:37.084495 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-41c73fa2-863b-48ad-83c9-3523aa539dd4 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1364 microversion: 2.1 time: 0.151395 Aug 22 12:51:37.085792 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 270/533] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:36 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:38.105111 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-20989c7b-6d6d-4c8d-95e6-f040c4be7546 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:38.105721 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-20989c7b-6d6d-4c8d-95e6-f040c4be7546 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:38.113098 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20989c7b-6d6d-4c8d-95e6-f040c4be7546 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:38.113585 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20989c7b-6d6d-4c8d-95e6-f040c4be7546 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:38.114029 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20989c7b-6d6d-4c8d-95e6-f040c4be7546 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:38.114748 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20989c7b-6d6d-4c8d-95e6-f040c4be7546 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:38.115206 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20989c7b-6d6d-4c8d-95e6-f040c4be7546 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:38.115630 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20989c7b-6d6d-4c8d-95e6-f040c4be7546 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:38.244248 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-20989c7b-6d6d-4c8d-95e6-f040c4be7546 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:38.251892 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-20989c7b-6d6d-4c8d-95e6-f040c4be7546 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1364 microversion: 2.1 time: 0.151259 Aug 22 12:51:38.252455 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 264/534] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:38 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:39.068618 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bfd41124-1ac0-4240-91ca-b2cde91f21f2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:39.069109 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bfd41124-1ac0-4240-91ca-b2cde91f21f2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:39.075657 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bfd41124-1ac0-4240-91ca-b2cde91f21f2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:39.076138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bfd41124-1ac0-4240-91ca-b2cde91f21f2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:39.076571 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bfd41124-1ac0-4240-91ca-b2cde91f21f2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:39.077261 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bfd41124-1ac0-4240-91ca-b2cde91f21f2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:39.077721 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bfd41124-1ac0-4240-91ca-b2cde91f21f2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:39.078748 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bfd41124-1ac0-4240-91ca-b2cde91f21f2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:39.103481 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bfd41124-1ac0-4240-91ca-b2cde91f21f2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:51:39.273165 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ca1717cb-4104-40bf-a1b9-aebdc0f544a3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:39.273732 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ca1717cb-4104-40bf-a1b9-aebdc0f544a3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:39.280315 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca1717cb-4104-40bf-a1b9-aebdc0f544a3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:39.280804 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca1717cb-4104-40bf-a1b9-aebdc0f544a3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:39.281848 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca1717cb-4104-40bf-a1b9-aebdc0f544a3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:39.282604 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca1717cb-4104-40bf-a1b9-aebdc0f544a3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:39.283070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca1717cb-4104-40bf-a1b9-aebdc0f544a3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:39.283510 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ca1717cb-4104-40bf-a1b9-aebdc0f544a3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:39.407541 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bfd41124-1ac0-4240-91ca-b2cde91f21f2 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "DELETE /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 204 len: 0 microversion: 2.1 time: 0.342458 Aug 22 12:51:39.408135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 271/535] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:51:39 2022] DELETE /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:51:39.412297 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ca1717cb-4104-40bf-a1b9-aebdc0f544a3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:39.416468 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e0b86ead-2450-4031-b37d-b3827ebb237d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:39.417156 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e0b86ead-2450-4031-b37d-b3827ebb237d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:39.419902 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ca1717cb-4104-40bf-a1b9-aebdc0f544a3 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1364 microversion: 2.1 time: 0.151071 Aug 22 12:51:39.420453 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 265/536] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:39 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:51:39.423149 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b86ead-2450-4031-b37d-b3827ebb237d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:39.423631 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b86ead-2450-4031-b37d-b3827ebb237d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:39.424067 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b86ead-2450-4031-b37d-b3827ebb237d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:39.424787 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b86ead-2450-4031-b37d-b3827ebb237d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:39.425240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b86ead-2450-4031-b37d-b3827ebb237d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:39.425659 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b86ead-2450-4031-b37d-b3827ebb237d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:39.557028 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e0b86ead-2450-4031-b37d-b3827ebb237d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:39.565277 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e0b86ead-2450-4031-b37d-b3827ebb237d tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1506 microversion: 2.1 time: 0.152921 Aug 22 12:51:39.565836 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 272/537] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:39 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:51:40.440506 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ae0fbdac-6be0-4f17-87ce-18e33c8dd9ca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:40.441253 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ae0fbdac-6be0-4f17-87ce-18e33c8dd9ca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:40.447511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ae0fbdac-6be0-4f17-87ce-18e33c8dd9ca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:40.448039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ae0fbdac-6be0-4f17-87ce-18e33c8dd9ca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:40.448427 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ae0fbdac-6be0-4f17-87ce-18e33c8dd9ca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:40.449119 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ae0fbdac-6be0-4f17-87ce-18e33c8dd9ca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:40.449574 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ae0fbdac-6be0-4f17-87ce-18e33c8dd9ca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:40.449999 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ae0fbdac-6be0-4f17-87ce-18e33c8dd9ca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:40.581918 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ae0fbdac-6be0-4f17-87ce-18e33c8dd9ca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:40.587105 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-39c15ab0-5fc7-435a-b3e9-d139c7991482 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:40.587598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ae0fbdac-6be0-4f17-87ce-18e33c8dd9ca tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1364 microversion: 2.1 time: 0.150638 Aug 22 12:51:40.588103 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 266/538] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:40 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:40.588225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-39c15ab0-5fc7-435a-b3e9-d139c7991482 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:40.595080 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-39c15ab0-5fc7-435a-b3e9-d139c7991482 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:40.595591 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-39c15ab0-5fc7-435a-b3e9-d139c7991482 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:40.596023 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-39c15ab0-5fc7-435a-b3e9-d139c7991482 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:40.596708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-39c15ab0-5fc7-435a-b3e9-d139c7991482 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:40.597160 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-39c15ab0-5fc7-435a-b3e9-d139c7991482 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:40.597578 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-39c15ab0-5fc7-435a-b3e9-d139c7991482 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:40.726010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-39c15ab0-5fc7-435a-b3e9-d139c7991482 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:40.733814 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-39c15ab0-5fc7-435a-b3e9-d139c7991482 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1506 microversion: 2.1 time: 0.150615 Aug 22 12:51:40.734400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 273/539] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:40 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:41.609345 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1a676f0c-e7f6-4f86-9427-8ff0c487fa6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:41.610404 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1a676f0c-e7f6-4f86-9427-8ff0c487fa6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:41.612258 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=6 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:41.617562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a676f0c-e7f6-4f86-9427-8ff0c487fa6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:41.623348 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a676f0c-e7f6-4f86-9427-8ff0c487fa6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:41.623348 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a676f0c-e7f6-4f86-9427-8ff0c487fa6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:41.623348 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a676f0c-e7f6-4f86-9427-8ff0c487fa6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:41.623348 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a676f0c-e7f6-4f86-9427-8ff0c487fa6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:41.623677 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a676f0c-e7f6-4f86-9427-8ff0c487fa6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:41.748285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1a676f0c-e7f6-4f86-9427-8ff0c487fa6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:41.754626 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6c17b866-f2a3-4b1b-a995-30b28a4f813f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:41.755876 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6c17b866-f2a3-4b1b-a995-30b28a4f813f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:41.756010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1a676f0c-e7f6-4f86-9427-8ff0c487fa6e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1364 microversion: 2.1 time: 0.151042 Aug 22 12:51:41.756485 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 267/540] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:41 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:41.758418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:41.759512 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=6 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:41.765477 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6c17b866-f2a3-4b1b-a995-30b28a4f813f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:41.767627 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6c17b866-f2a3-4b1b-a995-30b28a4f813f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:41.767627 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6c17b866-f2a3-4b1b-a995-30b28a4f813f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:41.767627 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6c17b866-f2a3-4b1b-a995-30b28a4f813f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:41.767627 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6c17b866-f2a3-4b1b-a995-30b28a4f813f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:41.768479 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6c17b866-f2a3-4b1b-a995-30b28a4f813f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:41.900746 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6c17b866-f2a3-4b1b-a995-30b28a4f813f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:41.909505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6c17b866-f2a3-4b1b-a995-30b28a4f813f tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1506 microversion: 2.1 time: 0.158651 Aug 22 12:51:41.910141 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 274/541] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:41 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:51:42.082350 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-0b0a79ec-3913-48ff-928c-dc78aa84fc09 req-86756349-2fe3-4ac9-906f-6c2c6062eef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15568e81-a422-4316-a242-0d24c7360ad3", "name": "network-vif-plugged", "status": "completed", "tag": "e0fc1842-b3f1-41ad-8953-f931c2cca090"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:42.092493 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-0b0a79ec-3913-48ff-928c-dc78aa84fc09 req-86756349-2fe3-4ac9-906f-6c2c6062eef1 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:42.093071 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-0b0a79ec-3913-48ff-928c-dc78aa84fc09 req-86756349-2fe3-4ac9-906f-6c2c6062eef1 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:42.093572 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-0b0a79ec-3913-48ff-928c-dc78aa84fc09 req-86756349-2fe3-4ac9-906f-6c2c6062eef1 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:42.105305 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-0b0a79ec-3913-48ff-928c-dc78aa84fc09 req-86756349-2fe3-4ac9-906f-6c2c6062eef1 service nova] Creating event network-vif-plugged:e0fc1842-b3f1-41ad-8953-f931c2cca090 for instance 15568e81-a422-4316-a242-0d24c7360ad3 on hv-cinder-85083 Aug 22 12:51:42.110321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-0b0a79ec-3913-48ff-928c-dc78aa84fc09 req-86756349-2fe3-4ac9-906f-6c2c6062eef1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032561 Aug 22 12:51:42.110937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 268/542] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:51:42.521148 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-f772cd45-1a15-48da-86b4-167c42a367dd req-285c8931-ca61-4236-a6a1-7d9e767409f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d3d67d-bb7d-4e73-961f-a359e2954db9", "name": "network-vif-deleted", "tag": "fcd8ebaa-5021-4d67-8795-1b1b3e62f91d"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:42.531501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-f772cd45-1a15-48da-86b4-167c42a367dd req-285c8931-ca61-4236-a6a1-7d9e767409f0 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:42.532035 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-f772cd45-1a15-48da-86b4-167c42a367dd req-285c8931-ca61-4236-a6a1-7d9e767409f0 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:42.532604 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-f772cd45-1a15-48da-86b4-167c42a367dd req-285c8931-ca61-4236-a6a1-7d9e767409f0 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:42.546677 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-f772cd45-1a15-48da-86b4-167c42a367dd req-285c8931-ca61-4236-a6a1-7d9e767409f0 service nova] Creating event network-vif-deleted:fcd8ebaa-5021-4d67-8795-1b1b3e62f91d for instance 08d3d67d-bb7d-4e73-961f-a359e2954db9 on hv-cinder-85083 Aug 22 12:51:42.551994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-f772cd45-1a15-48da-86b4-167c42a367dd req-285c8931-ca61-4236-a6a1-7d9e767409f0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036788 Aug 22 12:51:42.552864 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 275/543] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:51:42.780940 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a17ce31e-4739-464d-afcf-23fac897f493 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:42.781637 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a17ce31e-4739-464d-afcf-23fac897f493 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:42.788551 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a17ce31e-4739-464d-afcf-23fac897f493 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:42.789051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a17ce31e-4739-464d-afcf-23fac897f493 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:42.789491 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a17ce31e-4739-464d-afcf-23fac897f493 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:42.790230 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a17ce31e-4739-464d-afcf-23fac897f493 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:42.790695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a17ce31e-4739-464d-afcf-23fac897f493 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:42.791121 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a17ce31e-4739-464d-afcf-23fac897f493 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:42.932226 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2b684a18-3b33-4cbf-810d-ee1092cc7848 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:42.933984 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2b684a18-3b33-4cbf-810d-ee1092cc7848 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:42.941711 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2b684a18-3b33-4cbf-810d-ee1092cc7848 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:42.942233 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2b684a18-3b33-4cbf-810d-ee1092cc7848 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:42.942678 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2b684a18-3b33-4cbf-810d-ee1092cc7848 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:42.943612 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2b684a18-3b33-4cbf-810d-ee1092cc7848 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:42.944077 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2b684a18-3b33-4cbf-810d-ee1092cc7848 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:42.944504 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2b684a18-3b33-4cbf-810d-ee1092cc7848 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:43.098649 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2b684a18-3b33-4cbf-810d-ee1092cc7848 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:43.106939 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2b684a18-3b33-4cbf-810d-ee1092cc7848 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1292 microversion: 2.1 time: 0.178964 Aug 22 12:51:43.107665 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 276/544] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:42 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1292 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:51:43.156393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a17ce31e-4739-464d-afcf-23fac897f493 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:43.164436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a17ce31e-4739-464d-afcf-23fac897f493 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1364 microversion: 2.1 time: 0.388267 Aug 22 12:51:43.165004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 269/545] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:42 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1364 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:44.128638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:44.129184 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:44.136214 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:44.137058 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:44.137839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:44.139113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:44.139854 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:44.140524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:44.172149 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:44.172691 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:44.173126 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:44.173563 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lazy-loading 'fault' on Instance uuid 08d3d67d-bb7d-4e73-961f-a359e2954db9 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:51:44.184822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c12cd30b-5761-4572-9ad2-abc26fbb7ea0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:44.185430 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c12cd30b-5761-4572-9ad2-abc26fbb7ea0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:44.192663 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c12cd30b-5761-4572-9ad2-abc26fbb7ea0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:44.193372 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c12cd30b-5761-4572-9ad2-abc26fbb7ea0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:44.193810 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c12cd30b-5761-4572-9ad2-abc26fbb7ea0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:44.194540 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c12cd30b-5761-4572-9ad2-abc26fbb7ea0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:44.195876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c12cd30b-5761-4572-9ad2-abc26fbb7ea0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:44.195876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c12cd30b-5761-4572-9ad2-abc26fbb7ea0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:44.230835 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:44.240431 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7b86fc63-79ab-482c-9e2b-61e946a885a6 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 200 len: 1311 microversion: 2.1 time: 0.116087 Aug 22 12:51:44.241020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 277/546] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:44 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:44.328954 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c12cd30b-5761-4572-9ad2-abc26fbb7ea0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:44.337512 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c12cd30b-5761-4572-9ad2-abc26fbb7ea0 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1550 microversion: 2.1 time: 0.156461 Aug 22 12:51:44.338103 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 270/547] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:44 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:51:44.358156 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a444a92c-61db-4506-bf2a-b99ad60feb06 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:44.358688 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a444a92c-61db-4506-bf2a-b99ad60feb06 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:44.365984 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a444a92c-61db-4506-bf2a-b99ad60feb06 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:44.366507 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a444a92c-61db-4506-bf2a-b99ad60feb06 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:44.367148 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a444a92c-61db-4506-bf2a-b99ad60feb06 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:44.367885 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a444a92c-61db-4506-bf2a-b99ad60feb06 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:44.368340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a444a92c-61db-4506-bf2a-b99ad60feb06 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:44.368764 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a444a92c-61db-4506-bf2a-b99ad60feb06 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:44.383191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:44.445355 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a444a92c-61db-4506-bf2a-b99ad60feb06 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091025 Aug 22 12:51:44.445957 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 278/548] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 22 12:51:44 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:51:45.260934 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:45.261675 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 08d3d67d-bb7d-4e73-961f-a359e2954db9] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:45.269130 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:45.269620 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:45.270051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:45.270777 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:45.271283 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:45.271704 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:45.285511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] HTTP exception thrown: Instance 08d3d67d-bb7d-4e73-961f-a359e2954db9 could not be found. Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Request method failure captured: Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 HTTP/1.1 Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rHTwMTo6zGt_ez_vmdEnfXSSDlW_ImyAeBjZj5lPt9LtxzxK-5VBTsf3eRd136OGLX0aofzvbz2KqrBKfOr6yVt5iXGUXXbBLQCzrCJRuuhXMl3GBJuSZzIjP1u4jmmlxE81HPMY7Casqzy1V5P9wc5vH205JPMnat-aavB0Eamzk Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 30bf0498eabd4d9988b2084c0b082fad Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:51:45.287176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30bf0498eabd4d9988b2084c0b082fad"}]}] Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 30bf0498eabd4d9988b2084c0b082fad Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-ServerRescueNegativeTestJSON-93198942-project Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 9767d18cf0944f16b45fff4214128c1a Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-93198942-project Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 08d3d67d-bb7d-4e73-961f-a359e2954db9 could not be found. Aug 22 12:51:45.288666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '08d3d67d-bb7d-4e73-961f-a359e2954db9'} Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d3d67d-bb7d-4e73-961f-a359e2954db9 could not be found. Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:51:45.289494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d3d67d-bb7d-4e73-961f-a359e2954db9 could not be found. Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d3d67d-bb7d-4e73-961f-a359e2954db9 could not be found. Aug 22 12:51:45.290939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:45.293450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Returning 404 to user: Instance 08d3d67d-bb7d-4e73-961f-a359e2954db9 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:51:45.294323 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2682872e-8d68-4635-93be-adc337f9e7f0 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9" status: 404 len: 111 microversion: 2.1 time: 0.037371 Aug 22 12:51:45.298235 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 271/549] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:45 2022] GET /compute/v2.1/servers/08d3d67d-bb7d-4e73-961f-a359e2954db9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:51:45.303653 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-de199868-f9ab-4506-b6f1-a1b9a064c8e1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:45.304161 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-de199868-f9ab-4506-b6f1-a1b9a064c8e1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:45.310861 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de199868-f9ab-4506-b6f1-a1b9a064c8e1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:45.311349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de199868-f9ab-4506-b6f1-a1b9a064c8e1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:45.311783 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de199868-f9ab-4506-b6f1-a1b9a064c8e1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:45.312482 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de199868-f9ab-4506-b6f1-a1b9a064c8e1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:45.312941 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de199868-f9ab-4506-b6f1-a1b9a064c8e1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:45.313364 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de199868-f9ab-4506-b6f1-a1b9a064c8e1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:45.338514 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-de199868-f9ab-4506-b6f1-a1b9a064c8e1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:51:45.436582 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-c8cb11fa-0735-4512-8dcc-d1515bd14a7a req-fabb7430-c261-4c27-8f1d-c82027310603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15568e81-a422-4316-a242-0d24c7360ad3", "tag": "e0fc1842-b3f1-41ad-8953-f931c2cca090"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:45.446770 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c8cb11fa-0735-4512-8dcc-d1515bd14a7a req-fabb7430-c261-4c27-8f1d-c82027310603 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:45.447256 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c8cb11fa-0735-4512-8dcc-d1515bd14a7a req-fabb7430-c261-4c27-8f1d-c82027310603 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:45.451901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c8cb11fa-0735-4512-8dcc-d1515bd14a7a req-fabb7430-c261-4c27-8f1d-c82027310603 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:45.459508 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-c8cb11fa-0735-4512-8dcc-d1515bd14a7a req-fabb7430-c261-4c27-8f1d-c82027310603 service nova] Creating event network-changed:e0fc1842-b3f1-41ad-8953-f931c2cca090 for instance 15568e81-a422-4316-a242-0d24c7360ad3 on hv-cinder-85083 Aug 22 12:51:45.464490 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-c8cb11fa-0735-4512-8dcc-d1515bd14a7a req-fabb7430-c261-4c27-8f1d-c82027310603 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031812 Aug 22 12:51:45.465432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 272/550] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:51:45.732777 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-de199868-f9ab-4506-b6f1-a1b9a064c8e1 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 204 len: 0 microversion: 2.1 time: 0.433286 Aug 22 12:51:45.733594 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 279/551] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:51:45 2022] DELETE /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:51:45.741985 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8383e2d9-0347-45bb-bdce-81731b4396cb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:45.742744 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8383e2d9-0347-45bb-bdce-81731b4396cb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:45.744833 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:45.749783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8383e2d9-0347-45bb-bdce-81731b4396cb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:45.750304 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8383e2d9-0347-45bb-bdce-81731b4396cb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:45.751278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8383e2d9-0347-45bb-bdce-81731b4396cb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:45.751971 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8383e2d9-0347-45bb-bdce-81731b4396cb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:45.752425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8383e2d9-0347-45bb-bdce-81731b4396cb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:45.752849 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8383e2d9-0347-45bb-bdce-81731b4396cb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:45.887699 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8383e2d9-0347-45bb-bdce-81731b4396cb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:45.895386 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8383e2d9-0347-45bb-bdce-81731b4396cb tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.157475 Aug 22 12:51:45.903110 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 273/552] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:45 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:46.916466 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dcf652d3-6ec4-492a-9423-6fedfd764c6a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:46.917156 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-dcf652d3-6ec4-492a-9423-6fedfd764c6a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:46.924116 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dcf652d3-6ec4-492a-9423-6fedfd764c6a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:46.924593 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dcf652d3-6ec4-492a-9423-6fedfd764c6a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:46.925022 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dcf652d3-6ec4-492a-9423-6fedfd764c6a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:46.925704 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dcf652d3-6ec4-492a-9423-6fedfd764c6a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:46.926150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dcf652d3-6ec4-492a-9423-6fedfd764c6a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:46.926589 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dcf652d3-6ec4-492a-9423-6fedfd764c6a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:47.055454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-dcf652d3-6ec4-492a-9423-6fedfd764c6a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:47.063097 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-dcf652d3-6ec4-492a-9423-6fedfd764c6a tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.150830 Aug 22 12:51:47.063667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 280/553] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:46 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:48.084388 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7bd0d098-4b05-482e-af66-606dab817e10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:48.085020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7bd0d098-4b05-482e-af66-606dab817e10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:48.091369 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7bd0d098-4b05-482e-af66-606dab817e10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:48.091853 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7bd0d098-4b05-482e-af66-606dab817e10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:48.092284 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7bd0d098-4b05-482e-af66-606dab817e10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:48.092966 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7bd0d098-4b05-482e-af66-606dab817e10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:48.093420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7bd0d098-4b05-482e-af66-606dab817e10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:48.093871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7bd0d098-4b05-482e-af66-606dab817e10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:48.223473 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7bd0d098-4b05-482e-af66-606dab817e10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:48.231502 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7bd0d098-4b05-482e-af66-606dab817e10 tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.151598 Aug 22 12:51:48.232077 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 274/554] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:48 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:49.253349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-eb0fd732-e3ae-4bb2-9682-21fa7fc1b69b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:49.254001 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-eb0fd732-e3ae-4bb2-9682-21fa7fc1b69b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:49.265293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-eb0fd732-e3ae-4bb2-9682-21fa7fc1b69b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:49.265796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-eb0fd732-e3ae-4bb2-9682-21fa7fc1b69b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:49.266880 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-eb0fd732-e3ae-4bb2-9682-21fa7fc1b69b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:49.267607 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-eb0fd732-e3ae-4bb2-9682-21fa7fc1b69b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:49.268063 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-eb0fd732-e3ae-4bb2-9682-21fa7fc1b69b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:49.268492 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-eb0fd732-e3ae-4bb2-9682-21fa7fc1b69b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:49.455130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-eb0fd732-e3ae-4bb2-9682-21fa7fc1b69b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:49.462755 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-eb0fd732-e3ae-4bb2-9682-21fa7fc1b69b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1522 microversion: 2.1 time: 0.214069 Aug 22 12:51:49.463341 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 281/555] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:49 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:49.640656 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-3661d430-969a-488f-b734-0fbd189b63ba req-30628e0b-b468-4595-92c7-197a6fe90c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb90990-6e18-45a2-88c4-b725b54a21d6", "name": "network-vif-deleted", "tag": "b51d6432-4f41-4a2a-87f5-dc19cddc2adc"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:49.650699 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-3661d430-969a-488f-b734-0fbd189b63ba req-30628e0b-b468-4595-92c7-197a6fe90c26 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:49.651184 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-3661d430-969a-488f-b734-0fbd189b63ba req-30628e0b-b468-4595-92c7-197a6fe90c26 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:49.652333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-3661d430-969a-488f-b734-0fbd189b63ba req-30628e0b-b468-4595-92c7-197a6fe90c26 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:49.662462 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-3661d430-969a-488f-b734-0fbd189b63ba req-30628e0b-b468-4595-92c7-197a6fe90c26 service nova] Creating event network-vif-deleted:b51d6432-4f41-4a2a-87f5-dc19cddc2adc for instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 on hv-cinder-85083 Aug 22 12:51:49.667449 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-3661d430-969a-488f-b734-0fbd189b63ba req-30628e0b-b468-4595-92c7-197a6fe90c26 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030766 Aug 22 12:51:49.668039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 275/556] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:51:50.483542 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:50.484198 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:50.490270 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:50.490753 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:50.491181 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:50.491870 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:50.492322 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:50.492741 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:50.527000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:50.527471 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:50.527902 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:50.528342 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lazy-loading 'fault' on Instance uuid 3fb90990-6e18-45a2-88c4-b725b54a21d6 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:51:50.571697 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9767d18cf0944f16b45fff4214128c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bf0498eabd4d9988b2084c0b082fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:50.579868 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-41b47a62-8813-47f6-8fc8-f367c1099e2b tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 200 len: 1312 microversion: 2.1 time: 0.100261 Aug 22 12:51:50.580439 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 282/557] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:50 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:51:51.606389 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:51.607003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] [instance: 3fb90990-6e18-45a2-88c4-b725b54a21d6] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:51.613531 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:51.614010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:51.614469 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:51.615152 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:51.615599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:51.616018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:51.628739 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] HTTP exception thrown: Instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 could not be found. Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Request method failure captured: Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 HTTP/1.1 Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rHTwMTo6zGt_ez_vmdEnfXSSDlW_ImyAeBjZj5lPt9LtxzxK-5VBTsf3eRd136OGLX0aofzvbz2KqrBKfOr6yVt5iXGUXXbBLQCzrCJRuuhXMl3GBJuSZzIjP1u4jmmlxE81HPMY7Casqzy1V5P9wc5vH205JPMnat-aavB0Eamzk Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 30bf0498eabd4d9988b2084c0b082fad Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:51:51.630347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30bf0498eabd4d9988b2084c0b082fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30bf0498eabd4d9988b2084c0b082fad"}]}] Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 30bf0498eabd4d9988b2084c0b082fad Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-93198942 Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-ServerRescueNegativeTestJSON-93198942-project Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 9767d18cf0944f16b45fff4214128c1a Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-93198942-project Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 could not be found. Aug 22 12:51:51.631873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '3fb90990-6e18-45a2-88c4-b725b54a21d6'} Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 could not be found. Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:51:51.632726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 could not be found. Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 could not be found. Aug 22 12:51:51.634166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:51:51.635432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] Returning 404 to user: Instance 3fb90990-6e18-45a2-88c4-b725b54a21d6 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:51:51.635432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-eda264a9-2fad-4da2-b741-e410f758d82e tempest-ServerRescueNegativeTestJSON-93198942 tempest-ServerRescueNegativeTestJSON-93198942-project] 10.222.0.15 "GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6" status: 404 len: 111 microversion: 2.1 time: 0.030488 Aug 22 12:51:51.635432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 276/558] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:51:51 2022] GET /compute/v2.1/servers/3fb90990-6e18-45a2-88c4-b725b54a21d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:51:54.071782 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-4ccbaef8-0fbc-4fec-b5d5-b4fb97113e8d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:54.072305 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-4ccbaef8-0fbc-4fec-b5d5-b4fb97113e8d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:54.079290 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4ccbaef8-0fbc-4fec-b5d5-b4fb97113e8d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:54.079770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4ccbaef8-0fbc-4fec-b5d5-b4fb97113e8d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:54.080202 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4ccbaef8-0fbc-4fec-b5d5-b4fb97113e8d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:54.080895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4ccbaef8-0fbc-4fec-b5d5-b4fb97113e8d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:54.081441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4ccbaef8-0fbc-4fec-b5d5-b4fb97113e8d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:54.081886 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4ccbaef8-0fbc-4fec-b5d5-b4fb97113e8d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:54.106718 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-4ccbaef8-0fbc-4fec-b5d5-b4fb97113e8d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/ips" status: 200 len: 152 microversion: 2.20 time: 0.038796 Aug 22 12:51:54.107308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 283/559] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Aug 22 12:51:54 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:51:56.268306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b80a4211-904c-4395-8570-f853ce9f7403 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:51:56.268840 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b80a4211-904c-4395-8570-f853ce9f7403 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:56.274941 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b80a4211-904c-4395-8570-f853ce9f7403 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:56.275546 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b80a4211-904c-4395-8570-f853ce9f7403 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:56.275980 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b80a4211-904c-4395-8570-f853ce9f7403 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:56.276666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b80a4211-904c-4395-8570-f853ce9f7403 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:56.277114 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b80a4211-904c-4395-8570-f853ce9f7403 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:56.277531 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b80a4211-904c-4395-8570-f853ce9f7403 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:56.300926 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-b80a4211-904c-4395-8570-f853ce9f7403 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lazy-loading 'flavor' on Instance uuid 046710c4-dec2-4279-ab3f-297f3b5ba849 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:51:57.010635 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b80a4211-904c-4395-8570-f853ce9f7403 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "POST /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/action" status: 202 len: 0 microversion: 2.20 time: 0.755413 Aug 22 12:51:57.011765 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 277/560] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 22 12:51:56 2022] POST /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:51:57.020485 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:57.021732 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:57.029791 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:57.035515 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:57.035515 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:57.035515 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:57.035515 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:57.036017 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:57.334585 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:57.342752 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:57.344458 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:57.345625 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8ef1ea54-bea6-41d9-8609-8b2e6eb324ae tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.329740 Aug 22 12:51:57.346202 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 284/561] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:57 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:58.375977 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:58.376672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:58.382788 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:58.383272 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:58.383711 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:58.384403 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:58.384853 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:58.385274 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:58.513798 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:58.522658 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:58.524165 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:58.525321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e6ee358f-9785-474d-9b7f-fa7e32d4a0b5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.154607 Aug 22 12:51:58.525876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 278/562] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:58 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:51:59.548071 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:51:59.548697 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:51:59.555055 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:59.555547 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:59.555987 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:59.556703 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:51:59.557186 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:51:59.557616 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:51:59.701316 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:59.709982 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:59.711529 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:51:59.712725 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-beb57d5e-e13d-4400-8290-8a9b5cbcbd62 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.168552 Aug 22 12:51:59.713287 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 285/563] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:51:59 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:00.736746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:00.737297 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:00.743598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:00.744085 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:00.744524 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:00.745214 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:00.745673 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:00.746117 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:00.877853 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:00.886138 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:00.887774 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:00.888931 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a584fb05-c4f4-45e0-ae2c-7ba949ff5ee3 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.156698 Aug 22 12:52:00.889497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 279/564] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:00 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:01.912450 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:01.913176 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:01.919620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:01.920111 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:01.920552 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:01.921252 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:01.921712 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:01.922137 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:02.053721 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:02.061939 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:02.063978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:02.065126 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f1f37062-1ad1-46a3-865b-f59915bac8cf tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.156749 Aug 22 12:52:02.065683 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 286/565] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:01 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:52:03.088637 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:03.089249 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:03.096292 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:03.096789 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:03.097223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:03.097923 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:03.098401 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:03.099003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:03.225447 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:03.233861 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:03.235410 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:03.236570 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6e201cf0-9042-4b53-bb02-4b5fd3f4c8df tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.151861 Aug 22 12:52:03.237129 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 280/566] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:03 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:04.259005 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:04.259615 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:04.262413 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:04.269133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:04.269747 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:04.270195 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:04.270917 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:04.271454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:04.271881 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:04.436086 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:04.444148 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:04.445639 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:04.446911 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-370848f8-7ab3-4e4d-b8b1-6a399488dfac tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.191742 Aug 22 12:52:04.447720 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 287/567] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:04 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:05.476048 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:05.476617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:05.483526 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:05.484118 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:05.484557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:05.485262 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:05.485725 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:05.486157 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:05.489735 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:05.623152 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:05.629369 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:05.630901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:05.632045 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-701929cf-bfee-4d40-8d5a-942a60d16fad tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.160768 Aug 22 12:52:05.632600 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 281/568] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:05 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:06.655738 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:06.656350 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:06.662503 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:06.662984 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:06.663415 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:06.664101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:06.664559 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:06.664980 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:07.003167 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:07.011500 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:07.012988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:07.014168 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d3122be4-36ae-4f47-bf8b-b5cb8fd26189 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.362396 Aug 22 12:52:07.014866 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 288/569] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:06 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:08.037152 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:08.037760 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:08.044805 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:08.045288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:08.045723 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:08.046443 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:08.046940 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:08.055110 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:08.173341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:08.182076 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:08.183594 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:08.184749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-25e0baf6-2cff-4f19-9d9f-53cad64d8a59 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.151524 Aug 22 12:52:08.185305 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 282/570] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:08 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:09.379017 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:09.379635 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:09.385424 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:09.385909 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:09.386385 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:09.387085 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:09.387544 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:09.387970 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:09.519396 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:09.528210 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:09.529752 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:09.530921 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-5dfddce9-2d5e-4e73-9234-a4a056ee5dc5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.327264 Aug 22 12:52:09.531472 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 289/571] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:09 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:52:10.555037 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:10.555646 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:10.562310 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:10.562799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:10.563267 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:10.563980 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:10.564437 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:10.564865 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:10.693382 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:10.701388 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:10.702924 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:10.704077 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-94f1f0cd-4663-4df2-9b77-0ca595867e8f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.153910 Aug 22 12:52:10.704620 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 283/572] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:10 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:11.727311 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:11.728188 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:11.734643 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:11.735129 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:11.735566 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:11.736338 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:11.736796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:11.737226 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:11.869629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:11.877620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:11.879315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:11.880456 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1d9b3b42-8f65-45b1-aa1e-b6c74976fd41 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.157933 Aug 22 12:52:11.881545 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 290/573] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:11 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:12.903678 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:12.904292 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:12.910692 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:12.911178 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:12.911638 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:12.912813 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:12.913270 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:12.913694 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:13.045205 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:13.054257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:13.055930 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:13.056967 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-76262caa-dbd8-4ee2-aa91-7d518def5952 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1745 microversion: 2.20 time: 0.157138 Aug 22 12:52:13.057516 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 284/574] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:12 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:52:14.085777 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:14.086623 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:14.093007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:14.093488 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:14.093922 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:14.094642 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:14.095091 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:14.095513 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:14.225682 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:14.234174 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:14.235753 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:14.236904 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7674a0d3-d908-4a37-aa10-fc55734b9245 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1745 microversion: 2.20 time: 0.155089 Aug 22 12:52:14.237463 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 291/575] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:14 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:15.259914 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:15.260587 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:15.267108 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:15.267604 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:15.268052 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:15.268757 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:15.269266 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:15.269697 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:15.415096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:15.423313 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:15.424813 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:15.425964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3961e8c1-2c80-45b4-9359-aa2aa6e1c1da tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1740 microversion: 2.20 time: 0.170526 Aug 22 12:52:15.426549 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 285/576] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:15 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:16.196719 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-390dd2f6-98c6-41fe-87e8-b41390d7828b req-ea780a99-6cb5-430e-86cb-6cab0a1558c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046710c4-dec2-4279-ab3f-297f3b5ba849", "name": "network-vif-plugged", "status": "completed", "tag": "36a57df9-56c9-4cce-82c6-813a9eb66d52"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:52:16.210520 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-390dd2f6-98c6-41fe-87e8-b41390d7828b req-ea780a99-6cb5-430e-86cb-6cab0a1558c4 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:16.216723 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-390dd2f6-98c6-41fe-87e8-b41390d7828b req-ea780a99-6cb5-430e-86cb-6cab0a1558c4 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:16.217359 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-390dd2f6-98c6-41fe-87e8-b41390d7828b req-ea780a99-6cb5-430e-86cb-6cab0a1558c4 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:16.226991 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:16.235644 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-390dd2f6-98c6-41fe-87e8-b41390d7828b req-ea780a99-6cb5-430e-86cb-6cab0a1558c4 service nova] Creating event network-vif-plugged:36a57df9-56c9-4cce-82c6-813a9eb66d52 for instance 046710c4-dec2-4279-ab3f-297f3b5ba849 on hv-cinder-85083 Aug 22 12:52:16.241968 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-390dd2f6-98c6-41fe-87e8-b41390d7828b req-ea780a99-6cb5-430e-86cb-6cab0a1558c4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048538 Aug 22 12:52:16.246675 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 292/577] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:52:16.449463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:16.450003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:16.456893 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:16.457641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:16.458075 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:16.458863 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:16.459478 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:16.460060 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:16.636005 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:16.646213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:16.648614 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:16.650023 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b0c988a1-5e4f-429b-b524-cefa986571cd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1740 microversion: 2.20 time: 0.204471 Aug 22 12:52:16.663133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 286/578] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:16 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:17.675499 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:17.677110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:17.689739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:17.696341 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:17.697156 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:17.698006 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:17.698716 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:17.699246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:17.891922 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:17.900400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:17.902109 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:17.903608 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-fb1a8faa-783f-4dda-a31f-8a376f2aec4b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1740 microversion: 2.20 time: 0.232749 Aug 22 12:52:17.904392 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 293/579] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:17 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:52:18.928019 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:18.928636 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:18.935235 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:18.936028 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:18.936468 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:18.937194 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:18.937613 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:18.938038 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:19.109597 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:19.119204 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:19.120708 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:19.121870 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-38e83a8b-bb20-45bc-90a5-a12f37a88a96 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1740 microversion: 2.20 time: 0.197746 Aug 22 12:52:19.127081 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 287/580] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:18 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:20.145468 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:20.146092 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:20.159711 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:20.160222 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:20.160725 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:20.161450 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:20.161949 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:20.162650 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:20.400854 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:20.409520 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:20.411063 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:20.412478 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-08e1e047-6412-4aae-823a-47a8d8e8b9d1 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1740 microversion: 2.20 time: 0.271409 Aug 22 12:52:20.427973 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 294/581] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:20 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:21.436672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:21.437387 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:21.443557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=30 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:21.445209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:21.449661 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:21.449661 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:21.449661 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:21.449661 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:21.450045 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:21.638771 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:21.649633 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:21.651960 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:21.653491 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-9f79cfed-1a07-4577-9185-6f1ac34b6f11 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1740 microversion: 2.20 time: 0.221485 Aug 22 12:52:21.667463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 288/582] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:21 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:21.750542 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9d67413f-865e-4b1c-bcee-0e40344453c2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:21.751313 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9d67413f-865e-4b1c-bcee-0e40344453c2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:21.759810 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d67413f-865e-4b1c-bcee-0e40344453c2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:21.760361 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d67413f-865e-4b1c-bcee-0e40344453c2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:21.760886 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d67413f-865e-4b1c-bcee-0e40344453c2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:21.761606 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d67413f-865e-4b1c-bcee-0e40344453c2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:21.762149 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d67413f-865e-4b1c-bcee-0e40344453c2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:21.762618 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d67413f-865e-4b1c-bcee-0e40344453c2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:21.791784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9d67413f-865e-4b1c-bcee-0e40344453c2 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/ips" status: 200 len: 146 microversion: 2.1 time: 0.320617 Aug 22 12:52:21.792425 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 295/583] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 22 12:52:21 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/ips => generated 146 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:52:22.684384 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:22.685043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:22.694556 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:22.695281 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:22.695975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:22.696858 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:22.697500 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:22.697926 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:22.877143 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:22.888700 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:22.890223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:22.891426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e8982cc0-d9b9-4f9d-a2cf-2d02a03663a9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1740 microversion: 2.20 time: 0.211002 Aug 22 12:52:22.892295 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 289/584] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:22 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:23.752113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-66d36f77-1317-4140-b9b3-d6765033175e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "110d7497-22b8-4204-9d6b-d7084ff0bcd8"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:52:23.758038 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-66d36f77-1317-4140-b9b3-d6765033175e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:23.796047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-66d36f77-1317-4140-b9b3-d6765033175e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:23.796910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-66d36f77-1317-4140-b9b3-d6765033175e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:23.797661 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-66d36f77-1317-4140-b9b3-d6765033175e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:23.798697 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-66d36f77-1317-4140-b9b3-d6765033175e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:23.799239 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-66d36f77-1317-4140-b9b3-d6765033175e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:23.802780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-66d36f77-1317-4140-b9b3-d6765033175e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:23.920662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:23.921272 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:23.931864 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:23.932364 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:23.932794 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:23.937209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:23.939518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:23.940178 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:24.202527 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:24.225233 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:24.227511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:24.229397 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-601bea5c-f0d1-4d00-a949-249ee0c9e37f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1740 microversion: 2.20 time: 0.312739 Aug 22 12:52:24.230499 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 290/585] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:23 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:52:24.728797 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-66d36f77-1317-4140-b9b3-d6765033175e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "POST /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980181 Aug 22 12:52:24.729619 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 296/586] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:52:23 2022] POST /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments => generated 194 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:52:25.257390 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:25.257955 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:25.265195 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:25.265688 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:25.266121 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:25.266920 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:25.267375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:25.267799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:25.403222 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:25.411535 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:25.413356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:25.414786 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1b68dd0f-a9f6-4e92-bf1f-eb03a52a3825 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1740 microversion: 2.20 time: 0.161821 Aug 22 12:52:25.415479 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 291/587] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:25 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:26.440108 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:26.440972 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:26.453910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:26.454498 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:26.455030 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:26.456021 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:26.456496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:26.456995 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:26.595361 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:26.604521 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:26.606030 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:26.607232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e58761f2-dbf4-420b-b91d-1bd39bff686b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1740 microversion: 2.20 time: 0.172195 Aug 22 12:52:26.607786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 297/588] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:26 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:27.629298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:27.629913 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:27.636972 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:27.637460 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:27.637955 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:27.638684 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:27.639142 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:27.639571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:27.777754 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:27.786222 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:27.788400 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:27.789751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2536cce2-57f0-4e51-bbbc-03ef9fce1909 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1722 microversion: 2.20 time: 0.164435 Aug 22 12:52:27.790442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 292/589] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:27 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:28.813120 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:28.813747 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:28.821593 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:28.822082 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:28.822652 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:28.823361 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:28.823854 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:28.824290 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:28.972868 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:28.981182 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:28.982727 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:28.983886 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1a9cd262-b63e-4900-9e86-1223fc64767d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1722 microversion: 2.20 time: 0.174936 Aug 22 12:52:28.984472 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 298/590] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:28 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:30.007323 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:30.007929 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:30.014402 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:30.014884 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:30.015317 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:30.016005 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:30.016456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:30.016875 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:30.165009 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:30.176432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:30.178099 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:30.179398 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-419491bc-64af-4f7d-b466-b780dfa0e0ab tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1722 microversion: 2.20 time: 0.176538 Aug 22 12:52:30.189037 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 293/591] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:30 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:30.207675 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-a6ce67a7-bae9-4065-b299-988da9114423 req-ec9e1e48-0882-4c3e-af76-48ed03164fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046710c4-dec2-4279-ab3f-297f3b5ba849", "name": "network-vif-unplugged", "status": "completed", "tag": "36a57df9-56c9-4cce-82c6-813a9eb66d52"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:52:30.218930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-a6ce67a7-bae9-4065-b299-988da9114423 req-ec9e1e48-0882-4c3e-af76-48ed03164fff service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:30.222411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-a6ce67a7-bae9-4065-b299-988da9114423 req-ec9e1e48-0882-4c3e-af76-48ed03164fff service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:30.222411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-a6ce67a7-bae9-4065-b299-988da9114423 req-ec9e1e48-0882-4c3e-af76-48ed03164fff service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:30.231844 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-a6ce67a7-bae9-4065-b299-988da9114423 req-ec9e1e48-0882-4c3e-af76-48ed03164fff service nova] Creating event network-vif-unplugged:36a57df9-56c9-4cce-82c6-813a9eb66d52 for instance 046710c4-dec2-4279-ab3f-297f3b5ba849 on hv-cinder-85083 Aug 22 12:52:30.236570 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-a6ce67a7-bae9-4065-b299-988da9114423 req-ec9e1e48-0882-4c3e-af76-48ed03164fff service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032751 Aug 22 12:52:30.237160 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 299/592] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:52:31.203995 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:31.204533 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:31.211565 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:31.212048 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:31.212477 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:31.213168 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:31.213623 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:31.214042 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:31.342945 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:31.351481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:31.358110 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:31.358110 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3526cbde-ec7d-4057-8c1a-2c6a99082056 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1665 microversion: 2.20 time: 0.154504 Aug 22 12:52:31.358110 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 294/593] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:31 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:31.381069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7c6319b3-ef3a-497a-8e4a-8ccd906d9159 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccd2120c-4c2a-4a0e-b80f-536731d9c027"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:52:31.381069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7c6319b3-ef3a-497a-8e4a-8ccd906d9159 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:31.386391 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c6319b3-ef3a-497a-8e4a-8ccd906d9159 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:31.386879 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c6319b3-ef3a-497a-8e4a-8ccd906d9159 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:31.387315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c6319b3-ef3a-497a-8e4a-8ccd906d9159 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:31.388015 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c6319b3-ef3a-497a-8e4a-8ccd906d9159 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:31.388475 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c6319b3-ef3a-497a-8e4a-8ccd906d9159 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:31.388905 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7c6319b3-ef3a-497a-8e4a-8ccd906d9159 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:32.385348 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7c6319b3-ef3a-497a-8e4a-8ccd906d9159 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "POST /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.012902 Aug 22 12:52:32.386341 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 300/594] 10.222.0.15 () {62 vars in 1364 bytes} [Mon Aug 22 12:52:31 2022] POST /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/os-volume_attachments => generated 188 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 12:52:32.514678 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-206cc80d-e0e3-45c5-8be3-d0ad17f2d2c2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:32.515262 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-206cc80d-e0e3-45c5-8be3-d0ad17f2d2c2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:32.522300 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-206cc80d-e0e3-45c5-8be3-d0ad17f2d2c2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:32.522787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-206cc80d-e0e3-45c5-8be3-d0ad17f2d2c2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:32.523223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-206cc80d-e0e3-45c5-8be3-d0ad17f2d2c2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:32.523913 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-206cc80d-e0e3-45c5-8be3-d0ad17f2d2c2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:32.524399 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-206cc80d-e0e3-45c5-8be3-d0ad17f2d2c2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:32.524824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-206cc80d-e0e3-45c5-8be3-d0ad17f2d2c2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:32.995056 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:33.108123 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-206cc80d-e0e3-45c5-8be3-d0ad17f2d2c2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "DELETE /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/os-volume_attachments/ccd2120c-4c2a-4a0e-b80f-536731d9c027" status: 202 len: 0 microversion: 2.20 time: 0.597294 Aug 22 12:52:33.108725 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 295/595] 10.222.0.15 () {60 vars in 1457 bytes} [Mon Aug 22 12:52:32 2022] DELETE /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/os-volume_attachments/ccd2120c-4c2a-4a0e-b80f-536731d9c027 => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:52:33.167859 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b8d6663b-704a-4448-a9f8-fe5dd3617703 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:52:33.168465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b8d6663b-704a-4448-a9f8-fe5dd3617703 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:33.174401 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b8d6663b-704a-4448-a9f8-fe5dd3617703 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:33.174822 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b8d6663b-704a-4448-a9f8-fe5dd3617703 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:33.175251 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b8d6663b-704a-4448-a9f8-fe5dd3617703 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:33.175944 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b8d6663b-704a-4448-a9f8-fe5dd3617703 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:33.176398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b8d6663b-704a-4448-a9f8-fe5dd3617703 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:33.176818 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b8d6663b-704a-4448-a9f8-fe5dd3617703 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:33.206474 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b8d6663b-704a-4448-a9f8-fe5dd3617703 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127809) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 12:52:33.370543 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-29ea6558-b3ff-4652-a526-211b5f5a738f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:33.372761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-29ea6558-b3ff-4652-a526-211b5f5a738f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:33.379971 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-29ea6558-b3ff-4652-a526-211b5f5a738f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:33.381109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-29ea6558-b3ff-4652-a526-211b5f5a738f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:33.381546 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-29ea6558-b3ff-4652-a526-211b5f5a738f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:33.382271 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-29ea6558-b3ff-4652-a526-211b5f5a738f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:33.382727 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-29ea6558-b3ff-4652-a526-211b5f5a738f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:33.392803 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-29ea6558-b3ff-4652-a526-211b5f5a738f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:33.411146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-29ea6558-b3ff-4652-a526-211b5f5a738f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Aug 22 12:52:33.411780 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 296/596] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:52:33 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:52:33.421757 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c9ae9153-b0bd-4d3d-b4ad-0a8ffc72723e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:33.422272 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c9ae9153-b0bd-4d3d-b4ad-0a8ffc72723e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:33.428513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c9ae9153-b0bd-4d3d-b4ad-0a8ffc72723e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:33.428991 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c9ae9153-b0bd-4d3d-b4ad-0a8ffc72723e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:33.429420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c9ae9153-b0bd-4d3d-b4ad-0a8ffc72723e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:33.430148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c9ae9153-b0bd-4d3d-b4ad-0a8ffc72723e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:33.430632 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c9ae9153-b0bd-4d3d-b4ad-0a8ffc72723e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:33.431054 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c9ae9153-b0bd-4d3d-b4ad-0a8ffc72723e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:33.459329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c9ae9153-b0bd-4d3d-b4ad-0a8ffc72723e tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments/110d7497-22b8-4204-9d6b-d7084ff0bcd8" status: 200 len: 194 microversion: 2.1 time: 0.041092 Aug 22 12:52:33.459901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 297/597] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Aug 22 12:52:33 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments/110d7497-22b8-4204-9d6b-d7084ff0bcd8 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:52:33.522114 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b8d6663b-704a-4448-a9f8-fe5dd3617703 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "POST /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/action" status: 202 len: 0 microversion: 2.20 time: 0.358131 Aug 22 12:52:33.522754 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 301/598] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 22 12:52:33 2022] POST /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:52:33.533098 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:33.533461 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:33.541629 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:33.542333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:33.543318 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:33.543904 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:33.544573 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:33.545394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:33.686487 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:33.694928 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:33.696606 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:33.697752 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3c9d7694-88ac-40a7-9459-8bd9e267a1f9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1673 microversion: 2.20 time: 0.170756 Aug 22 12:52:33.698318 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 298/599] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:33 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:34.721224 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:34.721834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:34.723801 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:34.729329 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:34.734709 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:34.734709 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:34.734709 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:34.734709 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:34.735076 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:34.866956 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:34.875078 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:34.876585 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:34.877725 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0a1dcad3-96b0-4fd3-b58b-9baefa453bfd tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1673 microversion: 2.20 time: 0.160891 Aug 22 12:52:34.878331 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 302/600] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:34 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:35.114010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-26a61891-a8d3-402e-b3f5-a2dbbada8dd5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84655ba6-1256-4761-9b73-1689e5a07389"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:52:35.119981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-26a61891-a8d3-402e-b3f5-a2dbbada8dd5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:35.123813 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-26a61891-a8d3-402e-b3f5-a2dbbada8dd5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:35.124304 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-26a61891-a8d3-402e-b3f5-a2dbbada8dd5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:35.124742 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-26a61891-a8d3-402e-b3f5-a2dbbada8dd5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:35.125664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-26a61891-a8d3-402e-b3f5-a2dbbada8dd5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:35.126206 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-26a61891-a8d3-402e-b3f5-a2dbbada8dd5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:35.126678 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-26a61891-a8d3-402e-b3f5-a2dbbada8dd5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:35.901583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:35.902374 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:35.909368 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:35.909855 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:35.910316 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:35.911020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:35.911969 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:35.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:36.013500 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-26a61891-a8d3-402e-b3f5-a2dbbada8dd5 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "POST /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.903063 Aug 22 12:52:36.014546 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 299/601] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:52:35 2022] POST /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments => generated 194 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:52:36.050911 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:36.059814 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:36.061317 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:36.062482 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-805256c8-8d52-4d1b-8a9b-65dcf0044f76 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.164914 Aug 22 12:52:36.063029 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 303/602] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:35 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:37.086017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:37.086748 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:37.092871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:37.093368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:37.093808 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:37.094556 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:37.095096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:37.095454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:37.242959 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:37.251158 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:37.252830 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:37.254062 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6caaec54-5b4c-4ce8-b60e-d370a67a1a67 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.172856 Aug 22 12:52:37.255041 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 300/603] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:37 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:38.277956 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:38.278603 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:38.285348 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:38.286067 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:38.286577 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:38.287293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:38.287753 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:38.288205 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:38.432124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:38.441554 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:38.443858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:38.445036 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-55931738-e596-4266-b046-26b5b973f751 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.171127 Aug 22 12:52:38.445636 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 304/604] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:38 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:39.468986 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:39.470213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:39.478436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:39.479071 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:39.479788 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:39.480575 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:39.481109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:39.481615 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:39.652824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:39.661719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:39.663275 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:39.664449 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ccca56fa-ac2a-4cfb-992c-f2af83c20cf4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.199437 Aug 22 12:52:39.675029 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 301/605] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:39 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:40.687529 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:40.688095 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:40.695175 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:40.695910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:40.696352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:40.697062 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:40.699651 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:40.699651 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:40.713766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:40.853672 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:40.863095 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:40.865168 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:40.866395 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-22226e15-da40-4ae5-ae18-302e93181192 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.182847 Aug 22 12:52:40.867177 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 305/606] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:40 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:41.890298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:41.891701 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:41.900859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:41.901577 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:41.902619 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:41.904143 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:41.904782 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:41.905661 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:42.085658 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:42.094751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:42.096207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:42.097394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-cd405278-b523-46bc-8922-54545747095b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.210991 Aug 22 12:52:42.097971 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 302/607] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:41 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:43.124830 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:43.125462 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:43.133169 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:43.133733 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:43.134220 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:43.134985 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:43.135462 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:43.135929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:43.379979 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:43.393658 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:43.395334 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:43.396681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bd8509d1-30bd-4b56-89e0-187bd0f5beb5 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.276220 Aug 22 12:52:43.397365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 306/608] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:43 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:44.423073 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:44.423714 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:44.430946 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:44.431443 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:44.431890 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:44.432585 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:44.433042 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:44.433467 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:44.705044 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:44.714797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:44.716810 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:44.717967 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-765e3b39-004c-4fce-8208-a13ab645ca4c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.299009 Aug 22 12:52:44.718545 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 303/609] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:44 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:45.742748 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:45.744095 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:45.749898 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:45.750430 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:45.750868 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:45.751562 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:45.752015 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:45.752439 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:45.890365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:45.916940 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:45.916940 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:45.916940 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ee0c3e3e-e4fe-4da2-b084-c4d02a384856 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.163010 Aug 22 12:52:45.917346 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 307/610] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:45 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:46.927233 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:46.927911 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:46.934353 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:46.934846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:46.935296 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:46.936022 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:46.936483 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:46.936911 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:47.070712 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:47.078940 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:47.080454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:47.081619 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-9528f12f-0dc2-4d15-aa13-e1928309d62d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.158299 Aug 22 12:52:47.082174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 304/611] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:46 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:52:48.105869 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:48.106558 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:48.113262 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:48.113637 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:48.114077 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:48.115659 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:48.115852 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:48.116281 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:48.317416 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:48.326797 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:48.332248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:48.332248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-93367c07-6e27-4b71-8ed1-f2c0e6d05f50 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.228078 Aug 22 12:52:48.332248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 308/612] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:48 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:48.942534 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-aa7f3bf8-c46a-440b-ae0c-c214b9c73607 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:48.945276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-aa7f3bf8-c46a-440b-ae0c-c214b9c73607 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:48.951736 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa7f3bf8-c46a-440b-ae0c-c214b9c73607 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:48.952221 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa7f3bf8-c46a-440b-ae0c-c214b9c73607 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:48.952654 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa7f3bf8-c46a-440b-ae0c-c214b9c73607 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:48.953343 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa7f3bf8-c46a-440b-ae0c-c214b9c73607 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:48.953793 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa7f3bf8-c46a-440b-ae0c-c214b9c73607 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:48.954236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa7f3bf8-c46a-440b-ae0c-c214b9c73607 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:48.985947 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-aa7f3bf8-c46a-440b-ae0c-c214b9c73607 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047276 Aug 22 12:52:48.986811 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 305/613] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:52:48 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:52:49.135337 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b954b3ad-916c-4a14-8f51-c3f8f2e3c97b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:49.136522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b954b3ad-916c-4a14-8f51-c3f8f2e3c97b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:49.146847 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b954b3ad-916c-4a14-8f51-c3f8f2e3c97b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:49.147432 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b954b3ad-916c-4a14-8f51-c3f8f2e3c97b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:49.147878 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b954b3ad-916c-4a14-8f51-c3f8f2e3c97b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:49.148589 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b954b3ad-916c-4a14-8f51-c3f8f2e3c97b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:49.149123 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b954b3ad-916c-4a14-8f51-c3f8f2e3c97b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:49.149552 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b954b3ad-916c-4a14-8f51-c3f8f2e3c97b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:49.181023 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b954b3ad-916c-4a14-8f51-c3f8f2e3c97b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments/110d7497-22b8-4204-9d6b-d7084ff0bcd8" status: 200 len: 194 microversion: 2.1 time: 0.049644 Aug 22 12:52:49.181621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 309/614] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Aug 22 12:52:49 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments/110d7497-22b8-4204-9d6b-d7084ff0bcd8 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:52:49.192104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3272a075-acdb-4b73-be90-b4b82c1dbf1d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:49.192607 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3272a075-acdb-4b73-be90-b4b82c1dbf1d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:49.199087 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3272a075-acdb-4b73-be90-b4b82c1dbf1d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:49.199572 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3272a075-acdb-4b73-be90-b4b82c1dbf1d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:49.200023 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3272a075-acdb-4b73-be90-b4b82c1dbf1d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:49.200716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3272a075-acdb-4b73-be90-b4b82c1dbf1d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:49.201178 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3272a075-acdb-4b73-be90-b4b82c1dbf1d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:49.201612 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3272a075-acdb-4b73-be90-b4b82c1dbf1d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:49.288308 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-3272a075-acdb-4b73-be90-b4b82c1dbf1d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lazy-loading 'services' on Instance uuid 15568e81-a422-4316-a242-0d24c7360ad3 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:52:49.354699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:49.355315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:49.361117 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:49.361599 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:49.362034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:49.362754 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:49.363213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:49.363639 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:49.498362 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:49.506871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:49.513399 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:49.513399 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-72fe8eeb-6a2f-4846-b45f-ed50ca7d7b0d tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.159038 Aug 22 12:52:49.513399 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 310/615] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:49 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:52:49.595705 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3272a075-acdb-4b73-be90-b4b82c1dbf1d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "DELETE /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments/110d7497-22b8-4204-9d6b-d7084ff0bcd8" status: 202 len: 0 microversion: 2.1 time: 0.407291 Aug 22 12:52:49.596293 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 306/616] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 12:52:49 2022] DELETE /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments/110d7497-22b8-4204-9d6b-d7084ff0bcd8 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:52:50.386476 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-d3b46d96-21d7-48ab-b08a-4447e5b8302a req-5840dc62-dec7-488b-9fab-eba7ba73e110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046710c4-dec2-4279-ab3f-297f3b5ba849", "name": "network-vif-plugged", "status": "completed", "tag": "36a57df9-56c9-4cce-82c6-813a9eb66d52"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:52:50.396784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d3b46d96-21d7-48ab-b08a-4447e5b8302a req-5840dc62-dec7-488b-9fab-eba7ba73e110 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:50.397268 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d3b46d96-21d7-48ab-b08a-4447e5b8302a req-5840dc62-dec7-488b-9fab-eba7ba73e110 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:50.397701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d3b46d96-21d7-48ab-b08a-4447e5b8302a req-5840dc62-dec7-488b-9fab-eba7ba73e110 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:50.408893 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-d3b46d96-21d7-48ab-b08a-4447e5b8302a req-5840dc62-dec7-488b-9fab-eba7ba73e110 service nova] Creating event network-vif-plugged:36a57df9-56c9-4cce-82c6-813a9eb66d52 for instance 046710c4-dec2-4279-ab3f-297f3b5ba849 on hv-cinder-85083 Aug 22 12:52:50.414936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-d3b46d96-21d7-48ab-b08a-4447e5b8302a req-5840dc62-dec7-488b-9fab-eba7ba73e110 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150940 Aug 22 12:52:50.414936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 311/617] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:52:50.532320 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:50.533126 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:50.539314 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:50.539798 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:50.540232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:50.540922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:50.541379 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:50.541805 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:50.686981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:50.696935 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:50.700130 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:50.700130 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-04cffc61-8011-4ee6-8fcd-4693c8031883 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.172138 Aug 22 12:52:50.700530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 307/618] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:50 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:51.209960 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2046214353", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "networks": [{"uuid": "2cbd1d69-3ac7-4b6c-aff9-e48b78677f45"}]}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:52:51.267012 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] validate_networks() for [('2cbd1d69-3ac7-4b6c-aff9-e48b78677f45', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:52:51.688701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:52:51.689193 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:52:51.689574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:52:51.689979 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:52:51.690446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:52:51.699711 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:51.700131 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:51.700561 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:51.701283 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:51.701739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:51.702158 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:51.719512 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Getting quotas for project 0fa7ab184f2d475899be14a15bf9cb42. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:52:51.721796 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:51.722435 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:51.723594 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Getting quotas for user 5c8054538c6f4e8ebb890075aa1b7283 and project 0fa7ab184f2d475899be14a15bf9cb42. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:52:51.724868 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=40 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:51.731941 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:51.732688 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:51.733334 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:51.734324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:51.734923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:52:51.735063 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:51.735412 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:51.737294 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:52:51.871996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:51.880390 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:51.882409 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:51.883582 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b47b5c0b-aef1-4893-ad88-dc71a04152ed tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.165599 Aug 22 12:52:51.884160 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 308/619] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:51 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:52:52.029514 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-04d240a0-929c-486d-b1c5-6a625db33a52 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823890 Aug 22 12:52:52.030401 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 312/620] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:52:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:52:52.041304 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-70c13232-4e90-465c-908f-721ef300db72 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:52.045903 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-70c13232-4e90-465c-908f-721ef300db72 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:52.096943 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-70c13232-4e90-465c-908f-721ef300db72 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:52.104749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-70c13232-4e90-465c-908f-721ef300db72 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1214 microversion: 2.1 time: 0.067572 Aug 22 12:52:52.105326 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 309/621] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:52:52 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:52:52.829232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-46856791-f240-405b-a4e2-050449440937 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:52.829727 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-46856791-f240-405b-a4e2-050449440937 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:52.837529 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-46856791-f240-405b-a4e2-050449440937 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:52.840395 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-46856791-f240-405b-a4e2-050449440937 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:52.840395 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-46856791-f240-405b-a4e2-050449440937 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:52.840395 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-46856791-f240-405b-a4e2-050449440937 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:52.840395 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-46856791-f240-405b-a4e2-050449440937 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:52.840731 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-46856791-f240-405b-a4e2-050449440937 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:52.868066 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-46856791-f240-405b-a4e2-050449440937 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments/84655ba6-1256-4761-9b73-1689e5a07389" status: 200 len: 194 microversion: 2.1 time: 0.042704 Aug 22 12:52:52.873850 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 313/622] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Aug 22 12:52:52 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments/84655ba6-1256-4761-9b73-1689e5a07389 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:52:52.884824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-19cc1500-3779-49bb-8287-06dd8e1db18b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:52.884824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-19cc1500-3779-49bb-8287-06dd8e1db18b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:52.888631 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19cc1500-3779-49bb-8287-06dd8e1db18b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:52.889116 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19cc1500-3779-49bb-8287-06dd8e1db18b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:52.889546 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19cc1500-3779-49bb-8287-06dd8e1db18b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:52.890261 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19cc1500-3779-49bb-8287-06dd8e1db18b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:52.890713 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19cc1500-3779-49bb-8287-06dd8e1db18b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:52.891138 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-19cc1500-3779-49bb-8287-06dd8e1db18b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:52.906589 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:52.907210 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:52.914717 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:52.915243 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:52.915669 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:52.916391 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:52.916851 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:52.917281 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:52.973715 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:52.978828 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-19cc1500-3779-49bb-8287-06dd8e1db18b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lazy-loading 'services' on Instance uuid 15568e81-a422-4316-a242-0d24c7360ad3 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:52:53.058697 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:53.067021 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:53.069895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:53.069895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-dc07ac71-ef5a-482a-a70e-96771aefb660 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1731 microversion: 2.20 time: 0.166966 Aug 22 12:52:53.070331 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 314/623] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:52 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:52:53.125213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-97871779-f804-4974-bd35-3d7188bd4911 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:53.125743 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-97871779-f804-4974-bd35-3d7188bd4911 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:53.181406 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-97871779-f804-4974-bd35-3d7188bd4911 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:53.188545 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-97871779-f804-4974-bd35-3d7188bd4911 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1214 microversion: 2.1 time: 0.067119 Aug 22 12:52:53.189116 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 315/624] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:52:53 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:52:53.283343 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-19cc1500-3779-49bb-8287-06dd8e1db18b tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "DELETE /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments/84655ba6-1256-4761-9b73-1689e5a07389" status: 202 len: 0 microversion: 2.1 time: 0.406968 Aug 22 12:52:53.284320 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 310/625] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 12:52:52 2022] DELETE /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments/84655ba6-1256-4761-9b73-1689e5a07389 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:52:54.094306 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:54.095284 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:54.102082 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:54.102602 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:54.103300 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:54.103990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:54.104445 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:54.104897 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:54.210171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a33c60c0-fc58-4363-982d-6e399db632a0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:54.210994 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a33c60c0-fc58-4363-982d-6e399db632a0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:54.217719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a33c60c0-fc58-4363-982d-6e399db632a0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:54.218265 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a33c60c0-fc58-4363-982d-6e399db632a0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:54.218712 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a33c60c0-fc58-4363-982d-6e399db632a0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:54.219417 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a33c60c0-fc58-4363-982d-6e399db632a0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:54.219873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a33c60c0-fc58-4363-982d-6e399db632a0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:54.220298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a33c60c0-fc58-4363-982d-6e399db632a0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:54.249929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:54.266382 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:54.267978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:54.279768 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-10bbdd68-53b8-4361-b262-9565f437c23c tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1718 microversion: 2.20 time: 0.189244 Aug 22 12:52:54.280365 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 316/626] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:52:54 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1718 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:52:54.297994 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a33c60c0-fc58-4363-982d-6e399db632a0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:54.306245 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a33c60c0-fc58-4363-982d-6e399db632a0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1210 microversion: 2.1 time: 0.100053 Aug 22 12:52:54.306834 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 311/627] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:52:54 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:52:55.327972 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-20da9786-7fda-4776-a179-bc0bc6d34aa5 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:55.328590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-20da9786-7fda-4776-a179-bc0bc6d34aa5 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:55.335686 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-20da9786-7fda-4776-a179-bc0bc6d34aa5 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:55.336175 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-20da9786-7fda-4776-a179-bc0bc6d34aa5 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:55.336613 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-20da9786-7fda-4776-a179-bc0bc6d34aa5 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:55.337312 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-20da9786-7fda-4776-a179-bc0bc6d34aa5 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:55.337767 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-20da9786-7fda-4776-a179-bc0bc6d34aa5 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:55.338212 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-20da9786-7fda-4776-a179-bc0bc6d34aa5 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:55.423968 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-20da9786-7fda-4776-a179-bc0bc6d34aa5 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:55.434551 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-20da9786-7fda-4776-a179-bc0bc6d34aa5 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1274 microversion: 2.1 time: 0.109536 Aug 22 12:52:55.436303 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 317/628] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:52:55 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:52:55.533452 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-28325b1d-71f3-4d1b-8cc0-9f8198c2108d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:55.535748 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-28325b1d-71f3-4d1b-8cc0-9f8198c2108d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:55.542798 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-28325b1d-71f3-4d1b-8cc0-9f8198c2108d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:55.543229 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-28325b1d-71f3-4d1b-8cc0-9f8198c2108d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:55.543670 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-28325b1d-71f3-4d1b-8cc0-9f8198c2108d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:55.544458 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-28325b1d-71f3-4d1b-8cc0-9f8198c2108d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:55.544921 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-28325b1d-71f3-4d1b-8cc0-9f8198c2108d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:55.545353 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-28325b1d-71f3-4d1b-8cc0-9f8198c2108d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:55.575172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-28325b1d-71f3-4d1b-8cc0-9f8198c2108d tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045488 Aug 22 12:52:55.575738 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 312/629] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:52:55 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 12:52:55.706018 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f92421d3-a809-4e0c-a559-f28cb7ed8f68 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:55.708589 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f92421d3-a809-4e0c-a559-f28cb7ed8f68 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:55.715472 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f92421d3-a809-4e0c-a559-f28cb7ed8f68 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:55.715972 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f92421d3-a809-4e0c-a559-f28cb7ed8f68 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:55.716578 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f92421d3-a809-4e0c-a559-f28cb7ed8f68 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:55.717318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f92421d3-a809-4e0c-a559-f28cb7ed8f68 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:55.717781 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f92421d3-a809-4e0c-a559-f28cb7ed8f68 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:55.718237 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f92421d3-a809-4e0c-a559-f28cb7ed8f68 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:55.747899 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f92421d3-a809-4e0c-a559-f28cb7ed8f68 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045926 Aug 22 12:52:55.748471 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 318/630] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:52:55 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 12:52:55.809529 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1e2ff611-b60d-49bf-b70f-35edae47e9fb tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:55.810124 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1e2ff611-b60d-49bf-b70f-35edae47e9fb tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:55.816101 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1e2ff611-b60d-49bf-b70f-35edae47e9fb tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:55.816677 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1e2ff611-b60d-49bf-b70f-35edae47e9fb tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:55.817116 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1e2ff611-b60d-49bf-b70f-35edae47e9fb tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:55.817814 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1e2ff611-b60d-49bf-b70f-35edae47e9fb tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:55.818304 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1e2ff611-b60d-49bf-b70f-35edae47e9fb tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:55.819305 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1e2ff611-b60d-49bf-b70f-35edae47e9fb tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:55.843471 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1e2ff611-b60d-49bf-b70f-35edae47e9fb tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Going to try to terminate instance {{(pid=127810) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:52:56.105282 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1e2ff611-b60d-49bf-b70f-35edae47e9fb tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "DELETE /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 204 len: 0 microversion: 2.1 time: 0.299411 Aug 22 12:52:56.105873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 313/631] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:52:55 2022] DELETE /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:52:56.114006 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-145871c8-b365-4ba8-9320-580b3e8a95a1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:56.114679 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-145871c8-b365-4ba8-9320-580b3e8a95a1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:56.121191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-145871c8-b365-4ba8-9320-580b3e8a95a1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:56.121674 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-145871c8-b365-4ba8-9320-580b3e8a95a1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:56.122111 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-145871c8-b365-4ba8-9320-580b3e8a95a1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:56.122825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-145871c8-b365-4ba8-9320-580b3e8a95a1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:56.123285 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-145871c8-b365-4ba8-9320-580b3e8a95a1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:56.123708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-145871c8-b365-4ba8-9320-580b3e8a95a1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:56.257481 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-145871c8-b365-4ba8-9320-580b3e8a95a1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:56.265207 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-145871c8-b365-4ba8-9320-580b3e8a95a1 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1675 microversion: 2.1 time: 0.155035 Aug 22 12:52:56.265776 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 319/632] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:52:56 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:52:56.457032 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c3302b30-20b4-4907-932f-acf6ffec611e tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:56.457670 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c3302b30-20b4-4907-932f-acf6ffec611e tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:56.463555 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c3302b30-20b4-4907-932f-acf6ffec611e tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:56.464030 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c3302b30-20b4-4907-932f-acf6ffec611e tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:56.464454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c3302b30-20b4-4907-932f-acf6ffec611e tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:56.465130 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c3302b30-20b4-4907-932f-acf6ffec611e tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:56.465577 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c3302b30-20b4-4907-932f-acf6ffec611e tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:56.465993 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c3302b30-20b4-4907-932f-acf6ffec611e tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:56.593222 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c3302b30-20b4-4907-932f-acf6ffec611e tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:56.601542 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c3302b30-20b4-4907-932f-acf6ffec611e tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1314 microversion: 2.1 time: 0.148805 Aug 22 12:52:56.602127 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 314/633] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:52:56 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:52:57.286721 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f824a1fc-0138-4d22-ba66-861cfd062b83 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:57.287335 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f824a1fc-0138-4d22-ba66-861cfd062b83 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:57.293698 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f824a1fc-0138-4d22-ba66-861cfd062b83 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:57.294192 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f824a1fc-0138-4d22-ba66-861cfd062b83 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:57.294644 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f824a1fc-0138-4d22-ba66-861cfd062b83 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:57.295331 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f824a1fc-0138-4d22-ba66-861cfd062b83 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:57.295796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f824a1fc-0138-4d22-ba66-861cfd062b83 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:57.296220 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f824a1fc-0138-4d22-ba66-861cfd062b83 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:57.425880 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f824a1fc-0138-4d22-ba66-861cfd062b83 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:57.433990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f824a1fc-0138-4d22-ba66-861cfd062b83 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1675 microversion: 2.1 time: 0.151111 Aug 22 12:52:57.434590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 320/634] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:52:57 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:52:57.622686 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-de5eb397-4646-4e0e-a987-72cf5417b002 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:57.623215 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-de5eb397-4646-4e0e-a987-72cf5417b002 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:57.629500 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de5eb397-4646-4e0e-a987-72cf5417b002 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:57.629982 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de5eb397-4646-4e0e-a987-72cf5417b002 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:57.630460 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de5eb397-4646-4e0e-a987-72cf5417b002 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:57.631200 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de5eb397-4646-4e0e-a987-72cf5417b002 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:57.631654 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de5eb397-4646-4e0e-a987-72cf5417b002 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:57.632077 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-de5eb397-4646-4e0e-a987-72cf5417b002 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:57.834205 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-de5eb397-4646-4e0e-a987-72cf5417b002 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:57.841699 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-de5eb397-4646-4e0e-a987-72cf5417b002 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1314 microversion: 2.1 time: 0.222902 Aug 22 12:52:57.842491 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 315/635] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:52:57 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:52:58.457199 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e303e5b5-ede8-4adb-8b5b-6f71cfa04a8f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:58.458719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e303e5b5-ede8-4adb-8b5b-6f71cfa04a8f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:58.468479 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e303e5b5-ede8-4adb-8b5b-6f71cfa04a8f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:58.469431 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e303e5b5-ede8-4adb-8b5b-6f71cfa04a8f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:58.471042 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e303e5b5-ede8-4adb-8b5b-6f71cfa04a8f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:58.472985 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e303e5b5-ede8-4adb-8b5b-6f71cfa04a8f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:58.473613 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e303e5b5-ede8-4adb-8b5b-6f71cfa04a8f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:58.474314 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e303e5b5-ede8-4adb-8b5b-6f71cfa04a8f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:58.506481 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-05541cca-bdcf-487a-a79c-dc0fb8e903d4 req-985310d2-6c9c-4f08-a9b2-a989ca6f36dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f8c98b8-cca2-4273-8dde-59aa6e04360c", "tag": "8b736c4a-35a4-4a29-9fec-34a2f3222537"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:52:58.517154 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-05541cca-bdcf-487a-a79c-dc0fb8e903d4 req-985310d2-6c9c-4f08-a9b2-a989ca6f36dd service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:58.523309 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-05541cca-bdcf-487a-a79c-dc0fb8e903d4 req-985310d2-6c9c-4f08-a9b2-a989ca6f36dd service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:58.523309 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-05541cca-bdcf-487a-a79c-dc0fb8e903d4 req-985310d2-6c9c-4f08-a9b2-a989ca6f36dd service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:58.530482 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-05541cca-bdcf-487a-a79c-dc0fb8e903d4 req-985310d2-6c9c-4f08-a9b2-a989ca6f36dd service nova] Creating event network-changed:8b736c4a-35a4-4a29-9fec-34a2f3222537 for instance 0f8c98b8-cca2-4273-8dde-59aa6e04360c on hv-cinder-85083 Aug 22 12:52:58.535969 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-05541cca-bdcf-487a-a79c-dc0fb8e903d4 req-985310d2-6c9c-4f08-a9b2-a989ca6f36dd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104765 Aug 22 12:52:58.536573 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 321/636] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:52:58.653332 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e303e5b5-ede8-4adb-8b5b-6f71cfa04a8f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:58.661403 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e303e5b5-ede8-4adb-8b5b-6f71cfa04a8f tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1675 microversion: 2.1 time: 0.209493 Aug 22 12:52:58.666818 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 316/637] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:52:58 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1675 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:52:58.864329 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e0b9a649-6d5f-4a1a-bd4f-7ccfe97d4f5f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:58.865884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e0b9a649-6d5f-4a1a-bd4f-7ccfe97d4f5f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:58.872319 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b9a649-6d5f-4a1a-bd4f-7ccfe97d4f5f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:58.872808 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b9a649-6d5f-4a1a-bd4f-7ccfe97d4f5f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:58.873441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b9a649-6d5f-4a1a-bd4f-7ccfe97d4f5f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:58.874291 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b9a649-6d5f-4a1a-bd4f-7ccfe97d4f5f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:58.874632 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b9a649-6d5f-4a1a-bd4f-7ccfe97d4f5f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:58.875061 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0b9a649-6d5f-4a1a-bd4f-7ccfe97d4f5f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:59.031597 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-f34d7550-fab8-41dd-a403-f9a0ff651480 req-6b53bdbd-9002-4cd1-930b-e6aafab409e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15568e81-a422-4316-a242-0d24c7360ad3", "name": "network-vif-deleted", "tag": "e0fc1842-b3f1-41ad-8953-f931c2cca090"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:52:59.041282 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-f34d7550-fab8-41dd-a403-f9a0ff651480 req-6b53bdbd-9002-4cd1-930b-e6aafab409e4 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:59.047646 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-f34d7550-fab8-41dd-a403-f9a0ff651480 req-6b53bdbd-9002-4cd1-930b-e6aafab409e4 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:59.048770 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-f34d7550-fab8-41dd-a403-f9a0ff651480 req-6b53bdbd-9002-4cd1-930b-e6aafab409e4 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:59.062044 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-f34d7550-fab8-41dd-a403-f9a0ff651480 req-6b53bdbd-9002-4cd1-930b-e6aafab409e4 service nova] Creating event network-vif-deleted:e0fc1842-b3f1-41ad-8953-f931c2cca090 for instance 15568e81-a422-4316-a242-0d24c7360ad3 on hv-cinder-85083 Aug 22 12:52:59.067595 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-f34d7550-fab8-41dd-a403-f9a0ff651480 req-6b53bdbd-9002-4cd1-930b-e6aafab409e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116276 Aug 22 12:52:59.068389 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 317/638] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:52:59.102463 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e0b9a649-6d5f-4a1a-bd4f-7ccfe97d4f5f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:59.112593 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e0b9a649-6d5f-4a1a-bd4f-7ccfe97d4f5f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1314 microversion: 2.1 time: 0.252341 Aug 22 12:52:59.113554 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 322/639] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:52:58 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:52:59.693007 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:52:59.693717 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:52:59.700526 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:59.701004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:59.701442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:59.702201 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:59.702714 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:59.703141 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:59.737027 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:52:59.737613 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:52:59.737966 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:52:59.738446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lazy-loading 'fault' on Instance uuid 15568e81-a422-4316-a242-0d24c7360ad3 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:52:59.787997 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:52:59.795987 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a2055299-c487-4edd-9f60-b0c14b3482cc tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1328 microversion: 2.1 time: 0.108433 Aug 22 12:52:59.796568 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 318/640] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:52:59 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:00.133964 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a359f905-b57f-4881-85ee-731aea9f755f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:00.134716 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a359f905-b57f-4881-85ee-731aea9f755f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:00.141628 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a359f905-b57f-4881-85ee-731aea9f755f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:00.142139 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a359f905-b57f-4881-85ee-731aea9f755f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:00.142612 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a359f905-b57f-4881-85ee-731aea9f755f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:00.143310 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a359f905-b57f-4881-85ee-731aea9f755f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:00.143912 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a359f905-b57f-4881-85ee-731aea9f755f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:00.144342 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a359f905-b57f-4881-85ee-731aea9f755f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:00.271276 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a359f905-b57f-4881-85ee-731aea9f755f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:00.279220 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a359f905-b57f-4881-85ee-731aea9f755f tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1314 microversion: 2.1 time: 0.149720 Aug 22 12:53:00.279787 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 323/641] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:00 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:00.816370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:00.817139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:00.826977 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:00.827468 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:00.827901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:00.828595 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:00.829043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:00.829464 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:00.868771 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:00.869164 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:00.869591 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:00.870031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lazy-loading 'fault' on Instance uuid 15568e81-a422-4316-a242-0d24c7360ad3 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:53:00.912980 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1db5be49014d2cba63cdee9df5b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e81d9adcb6477aa19c0cbacca01351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:00.920679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-57f1fe19-2210-4d44-a00c-d8acf8d5d4cd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 200 len: 1328 microversion: 2.1 time: 0.108121 Aug 22 12:53:00.921233 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 319/642] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:00 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:01.299532 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7cb1ab57-0ac3-41ec-8298-f53d59c43f4c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:01.300793 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7cb1ab57-0ac3-41ec-8298-f53d59c43f4c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:01.307322 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb1ab57-0ac3-41ec-8298-f53d59c43f4c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:01.307839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb1ab57-0ac3-41ec-8298-f53d59c43f4c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:01.308302 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb1ab57-0ac3-41ec-8298-f53d59c43f4c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:01.309005 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb1ab57-0ac3-41ec-8298-f53d59c43f4c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:01.309462 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb1ab57-0ac3-41ec-8298-f53d59c43f4c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:01.309886 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7cb1ab57-0ac3-41ec-8298-f53d59c43f4c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:01.438077 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7cb1ab57-0ac3-41ec-8298-f53d59c43f4c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:01.446192 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7cb1ab57-0ac3-41ec-8298-f53d59c43f4c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1314 microversion: 2.1 time: 0.150513 Aug 22 12:53:01.446770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 324/643] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:01 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:01.942028 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:01.942660 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:01.949503 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:01.949986 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:01.950457 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:01.951143 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:01.951591 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:01.952038 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:01.964640 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] HTTP exception thrown: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Request method failure captured: Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 HTTP/1.1 Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rM2waID04oKd1_4SuYiX9kYL54gjmpSQ7QFoGMOisE65PmeEAqf2V_1PMo3pMQ00SvrQRF5gRcaDw8yps9dTrOazM28FTuGUwXr31k19jt3vd_jTX75MTKt2b91FwXtaazS6kDjhd4AaWZ1nXqpOQFpj-jv04FUxGJY8unaf4No4A Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:53:01.966236 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2e81d9adcb6477aa19c0cbacca01351"}]}] Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 5b1db5be49014d2cba63cdee9df5b1d0 Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:01.967820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '15568e81-a422-4316-a242-0d24c7360ad3'} Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:01.968746 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:01.970243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:01.971627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Returning 404 to user: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:01.971627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0eabc14c-6c9e-40ff-be6a-2eed956166bf tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 404 len: 111 microversion: 2.1 time: 0.029385 Aug 22 12:53:01.971627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 320/644] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:01 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 12:53:01.976478 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-65926c7f-2501-4856-82ad-dae8967b541c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '.version_select at 0x7f7659d184c0>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:01.981315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:02.094402 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-65926c7f-2501-4856-82ad-dae8967b541c tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882659064" status: 202 len: 0 microversion: 2.1 time: 0.121600 Aug 22 12:53:02.095009 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 325/645] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 22 12:53:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882659064 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:53:02.466778 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-676eb509-f23a-4a21-bcfb-6ede8168f7c3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:02.467238 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-676eb509-f23a-4a21-bcfb-6ede8168f7c3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:02.470460 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:02.474292 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-676eb509-f23a-4a21-bcfb-6ede8168f7c3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:02.475290 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-676eb509-f23a-4a21-bcfb-6ede8168f7c3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:02.475775 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-676eb509-f23a-4a21-bcfb-6ede8168f7c3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:02.476455 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-676eb509-f23a-4a21-bcfb-6ede8168f7c3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:02.476928 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-676eb509-f23a-4a21-bcfb-6ede8168f7c3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:02.477453 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-676eb509-f23a-4a21-bcfb-6ede8168f7c3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:02.823863 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-676eb509-f23a-4a21-bcfb-6ede8168f7c3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:02.831805 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-676eb509-f23a-4a21-bcfb-6ede8168f7c3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1314 microversion: 2.1 time: 0.369189 Aug 22 12:53:02.838534 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 321/646] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:02 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:03.849904 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=8 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:03.854142 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0647bd34-3695-4f09-ab62-605c0724c2c2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:03.854771 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0647bd34-3695-4f09-ab62-605c0724c2c2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:03.860566 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0647bd34-3695-4f09-ab62-605c0724c2c2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:03.861045 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0647bd34-3695-4f09-ab62-605c0724c2c2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:03.861505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0647bd34-3695-4f09-ab62-605c0724c2c2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:03.862207 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0647bd34-3695-4f09-ab62-605c0724c2c2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:03.862718 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0647bd34-3695-4f09-ab62-605c0724c2c2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:03.863142 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0647bd34-3695-4f09-ab62-605c0724c2c2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:03.866171 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=100 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:03.998375 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0647bd34-3695-4f09-ab62-605c0724c2c2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:04.007850 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0647bd34-3695-4f09-ab62-605c0724c2c2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1314 microversion: 2.1 time: 0.159639 Aug 22 12:53:04.008420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 326/647] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:03 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:04.432237 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-338c65cc-d0e7-4f7d-985c-26bb9acc988c req-a39f591c-e980-4221-9f45-fd4de01169eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8c98b8-cca2-4273-8dde-59aa6e04360c", "name": "network-vif-plugged", "status": "completed", "tag": "8b736c4a-35a4-4a29-9fec-34a2f3222537"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:04.443680 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-338c65cc-d0e7-4f7d-985c-26bb9acc988c req-a39f591c-e980-4221-9f45-fd4de01169eb service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:04.444217 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-338c65cc-d0e7-4f7d-985c-26bb9acc988c req-a39f591c-e980-4221-9f45-fd4de01169eb service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:04.444869 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-338c65cc-d0e7-4f7d-985c-26bb9acc988c req-a39f591c-e980-4221-9f45-fd4de01169eb service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:04.456043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-338c65cc-d0e7-4f7d-985c-26bb9acc988c req-a39f591c-e980-4221-9f45-fd4de01169eb service nova] Creating event network-vif-plugged:8b736c4a-35a4-4a29-9fec-34a2f3222537 for instance 0f8c98b8-cca2-4273-8dde-59aa6e04360c on hv-cinder-85083 Aug 22 12:53:04.461096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-338c65cc-d0e7-4f7d-985c-26bb9acc988c req-a39f591c-e980-4221-9f45-fd4de01169eb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033535 Aug 22 12:53:04.461670 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 322/648] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:53:05.028562 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6e19c017-275f-446c-bb76-2a94bea359b0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:05.029172 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6e19c017-275f-446c-bb76-2a94bea359b0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:05.035545 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e19c017-275f-446c-bb76-2a94bea359b0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:05.036027 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e19c017-275f-446c-bb76-2a94bea359b0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:05.036458 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e19c017-275f-446c-bb76-2a94bea359b0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:05.037722 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e19c017-275f-446c-bb76-2a94bea359b0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:05.038206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e19c017-275f-446c-bb76-2a94bea359b0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:05.038620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e19c017-275f-446c-bb76-2a94bea359b0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:05.179265 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6e19c017-275f-446c-bb76-2a94bea359b0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:05.187049 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6e19c017-275f-446c-bb76-2a94bea359b0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1314 microversion: 2.1 time: 0.162678 Aug 22 12:53:05.187618 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 327/649] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:05 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:05.733358 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:05.733968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:05.740719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:05.741199 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:05.741635 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:05.742389 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:05.742845 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:05.743266 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:05.756695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] HTTP exception thrown: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Request method failure captured: Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: DELETE /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 HTTP/1.1 Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rM2waID04oKd1_4SuYiX9kYL54gjmpSQ7QFoGMOisE65PmeEAqf2V_1PMo3pMQ00SvrQRF5gRcaDw8yps9dTrOazM28FTuGUwXr31k19jt3vd_jTX75MTKt2b91FwXtaazS6kDjhd4AaWZ1nXqpOQFpj-jv04FUxGJY8unaf4No4A Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:53:05.758321 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2e81d9adcb6477aa19c0cbacca01351"}]}] Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 5b1db5be49014d2cba63cdee9df5b1d0 Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:05.759894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '15568e81-a422-4316-a242-0d24c7360ad3'} Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:05.760669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:05.762031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:05.763393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Returning 404 to user: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:05.763393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f77aa1e0-c720-4105-a839-16b606482c48 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "DELETE /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 404 len: 111 microversion: 2.1 time: 0.031345 Aug 22 12:53:05.763393 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 323/650] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:53:05 2022] DELETE /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:53:05.768023 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:05.768638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 15568e81-a422-4316-a242-0d24c7360ad3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:05.774588 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:05.775076 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:05.775513 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:05.776202 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:05.776662 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:05.777089 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:05.789935 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] HTTP exception thrown: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Request method failure captured: Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 HTTP/1.1 Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3rM2waID04oKd1_4SuYiX9kYL54gjmpSQ7QFoGMOisE65PmeEAqf2V_1PMo3pMQ00SvrQRF5gRcaDw8yps9dTrOazM28FTuGUwXr31k19jt3vd_jTX75MTKt2b91FwXtaazS6kDjhd4AaWZ1nXqpOQFpj-jv04FUxGJY8unaf4No4A Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:53:05.791596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2e81d9adcb6477aa19c0cbacca01351"}]}] Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 5b1db5be49014d2cba63cdee9df5b1d0 Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:05.793059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '15568e81-a422-4316-a242-0d24c7360ad3'} Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:05.793858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. Aug 22 12:53:05.795150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:05.796191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Returning 404 to user: Instance 15568e81-a422-4316-a242-0d24c7360ad3 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:05.796191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8c2fab31-3328-4831-a98c-e56084f03ef7 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3" status: 404 len: 111 microversion: 2.1 time: 0.028769 Aug 22 12:53:05.796191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 328/651] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:05 2022] GET /compute/v2.1/servers/15568e81-a422-4316-a242-0d24c7360ad3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 12:53:06.207548 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-76524db1-70d8-43cb-8908-bbc2de0c6961 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:06.208166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-76524db1-70d8-43cb-8908-bbc2de0c6961 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:06.214100 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76524db1-70d8-43cb-8908-bbc2de0c6961 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:06.214616 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76524db1-70d8-43cb-8908-bbc2de0c6961 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:06.215051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76524db1-70d8-43cb-8908-bbc2de0c6961 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:06.215773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76524db1-70d8-43cb-8908-bbc2de0c6961 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:06.216232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76524db1-70d8-43cb-8908-bbc2de0c6961 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:06.216659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-76524db1-70d8-43cb-8908-bbc2de0c6961 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:06.352618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-76524db1-70d8-43cb-8908-bbc2de0c6961 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:06.360547 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-76524db1-70d8-43cb-8908-bbc2de0c6961 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1314 microversion: 2.1 time: 0.156945 Aug 22 12:53:06.361110 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 324/652] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:06 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:07.075726 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:07.076230 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:07.078537 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:07.083163 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:07.083648 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:07.084574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:07.085268 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:07.085727 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:07.086153 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:07.100936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] HTTP exception thrown: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Request method failure captured: Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: DELETE /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 HTTP/1.1 Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3rM2waID04oKd1_4SuYiX9kYL54gjmpSQ7QFoGMOisE65PmeEAqf2V_1PMo3pMQ00SvrQRF5gRcaDw8yps9dTrOazM28FTuGUwXr31k19jt3vd_jTX75MTKt2b91FwXtaazS6kDjhd4AaWZ1nXqpOQFpj-jv04FUxGJY8unaf4No4A Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:53:07.102530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2e81d9adcb6477aa19c0cbacca01351"}]}] Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 5b1db5be49014d2cba63cdee9df5b1d0 Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:53:07.104327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '48cd5dbe-4358-40f8-9515-87434787eca4'} Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:07.105143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:53:07.106667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:07.108012 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Returning 404 to user: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:07.108012 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-5098ef5b-e74c-48d9-9cb3-9e532c798cdd tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "DELETE /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 404 len: 111 microversion: 2.1 time: 0.032263 Aug 22 12:53:07.108012 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 329/653] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:53:07 2022] DELETE /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:53:07.112836 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:07.113447 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] [instance: 48cd5dbe-4358-40f8-9515-87434787eca4] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:07.119857 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:07.120366 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:07.120800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:07.121488 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:07.121949 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:07.122429 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:07.135290 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] HTTP exception thrown: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Request method failure captured: Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 HTTP/1.1 Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rM2waID04oKd1_4SuYiX9kYL54gjmpSQ7QFoGMOisE65PmeEAqf2V_1PMo3pMQ00SvrQRF5gRcaDw8yps9dTrOazM28FTuGUwXr31k19jt3vd_jTX75MTKt2b91FwXtaazS6kDjhd4AaWZ1nXqpOQFpj-jv04FUxGJY8unaf4No4A Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:53:07.136783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2e81d9adcb6477aa19c0cbacca01351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2e81d9adcb6477aa19c0cbacca01351"}]}] Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: d2e81d9adcb6477aa19c0cbacca01351 Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-61785935 Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 5b1db5be49014d2cba63cdee9df5b1d0 Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeTestJSON-61785935-project Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:53:07.138298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '48cd5dbe-4358-40f8-9515-87434787eca4'} Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:07.139104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. Aug 22 12:53:07.140227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:07.141288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] Returning 404 to user: Instance 48cd5dbe-4358-40f8-9515-87434787eca4 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:07.141288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8e599af5-6762-45ab-89e7-952e7bdd6981 tempest-AttachVolumeTestJSON-61785935 tempest-AttachVolumeTestJSON-61785935-project] 10.222.0.15 "GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4" status: 404 len: 111 microversion: 2.1 time: 0.029204 Aug 22 12:53:07.141288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 325/654] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:07 2022] GET /compute/v2.1/servers/48cd5dbe-4358-40f8-9515-87434787eca4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:53:07.381522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a4ede88d-4612-444b-b1d1-2ac0b3c11512 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:07.382265 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a4ede88d-4612-444b-b1d1-2ac0b3c11512 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:07.388756 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4ede88d-4612-444b-b1d1-2ac0b3c11512 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:07.389320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4ede88d-4612-444b-b1d1-2ac0b3c11512 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:07.389766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4ede88d-4612-444b-b1d1-2ac0b3c11512 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:07.390510 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4ede88d-4612-444b-b1d1-2ac0b3c11512 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:07.390977 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4ede88d-4612-444b-b1d1-2ac0b3c11512 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:07.391405 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a4ede88d-4612-444b-b1d1-2ac0b3c11512 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:07.698306 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a4ede88d-4612-444b-b1d1-2ac0b3c11512 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:07.706454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a4ede88d-4612-444b-b1d1-2ac0b3c11512 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1499 microversion: 2.1 time: 0.328791 Aug 22 12:53:07.707028 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 330/655] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:07 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1499 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:08.679121 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-63b59aa3-8d30-4c5f-8736-b243230c9e21 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:08.679612 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-63b59aa3-8d30-4c5f-8736-b243230c9e21 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:08.686000 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63b59aa3-8d30-4c5f-8736-b243230c9e21 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:08.686519 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63b59aa3-8d30-4c5f-8736-b243230c9e21 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:08.687049 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63b59aa3-8d30-4c5f-8736-b243230c9e21 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:08.687743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63b59aa3-8d30-4c5f-8736-b243230c9e21 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:08.688198 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63b59aa3-8d30-4c5f-8736-b243230c9e21 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:08.688629 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63b59aa3-8d30-4c5f-8736-b243230c9e21 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:08.713767 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-63b59aa3-8d30-4c5f-8736-b243230c9e21 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Going to try to terminate instance {{(pid=127810) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:53:08.749562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:09.264590 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-63b59aa3-8d30-4c5f-8736-b243230c9e21 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 204 len: 0 microversion: 2.1 time: 0.589049 Aug 22 12:53:09.265420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 326/656] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:53:08 2022] DELETE /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:53:09.273632 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-84ff5da7-af93-47be-ac2e-a707ca0c3a1d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:09.294297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-84ff5da7-af93-47be-ac2e-a707ca0c3a1d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:09.294297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84ff5da7-af93-47be-ac2e-a707ca0c3a1d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:09.294297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84ff5da7-af93-47be-ac2e-a707ca0c3a1d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:09.294297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84ff5da7-af93-47be-ac2e-a707ca0c3a1d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:09.295222 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84ff5da7-af93-47be-ac2e-a707ca0c3a1d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:09.295222 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84ff5da7-af93-47be-ac2e-a707ca0c3a1d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:09.295222 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-84ff5da7-af93-47be-ac2e-a707ca0c3a1d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:09.420997 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-84ff5da7-af93-47be-ac2e-a707ca0c3a1d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:09.429015 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-84ff5da7-af93-47be-ac2e-a707ca0c3a1d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1505 microversion: 2.1 time: 0.159037 Aug 22 12:53:09.429726 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 331/657] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:09 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:10.453486 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-bb16e754-7156-4158-a716-795134ec07e9 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:10.454412 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-bb16e754-7156-4158-a716-795134ec07e9 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:10.461477 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb16e754-7156-4158-a716-795134ec07e9 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:10.461967 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb16e754-7156-4158-a716-795134ec07e9 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:10.462429 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb16e754-7156-4158-a716-795134ec07e9 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:10.463131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb16e754-7156-4158-a716-795134ec07e9 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:10.463587 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb16e754-7156-4158-a716-795134ec07e9 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:10.464026 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bb16e754-7156-4158-a716-795134ec07e9 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:10.596912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-bb16e754-7156-4158-a716-795134ec07e9 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:10.605623 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-bb16e754-7156-4158-a716-795134ec07e9 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1505 microversion: 2.1 time: 0.156411 Aug 22 12:53:10.607064 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 327/658] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:10 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:11.633641 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-72266929-4ad5-47b8-b04d-cb663d90294d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:11.634499 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-72266929-4ad5-47b8-b04d-cb663d90294d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:11.641298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72266929-4ad5-47b8-b04d-cb663d90294d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:11.641779 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72266929-4ad5-47b8-b04d-cb663d90294d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:11.642245 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72266929-4ad5-47b8-b04d-cb663d90294d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:11.642940 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72266929-4ad5-47b8-b04d-cb663d90294d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:11.643396 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72266929-4ad5-47b8-b04d-cb663d90294d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:11.643821 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-72266929-4ad5-47b8-b04d-cb663d90294d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:11.731420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-72266929-4ad5-47b8-b04d-cb663d90294d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:11.745129 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-72266929-4ad5-47b8-b04d-cb663d90294d tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1463 microversion: 2.1 time: 0.115934 Aug 22 12:53:11.748524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 332/659] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:11 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1463 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:11.794601 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-9b67db34-e149-4d96-87b1-f933410570fe req-b5176b2e-f77d-421e-85b8-61341568005b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8c98b8-cca2-4273-8dde-59aa6e04360c", "name": "network-vif-deleted", "tag": "8b736c4a-35a4-4a29-9fec-34a2f3222537"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:11.804804 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-9b67db34-e149-4d96-87b1-f933410570fe req-b5176b2e-f77d-421e-85b8-61341568005b service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:11.805281 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-9b67db34-e149-4d96-87b1-f933410570fe req-b5176b2e-f77d-421e-85b8-61341568005b service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:11.805710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-9b67db34-e149-4d96-87b1-f933410570fe req-b5176b2e-f77d-421e-85b8-61341568005b service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:11.816341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-9b67db34-e149-4d96-87b1-f933410570fe req-b5176b2e-f77d-421e-85b8-61341568005b service nova] Creating event network-vif-deleted:8b736c4a-35a4-4a29-9fec-34a2f3222537 for instance 0f8c98b8-cca2-4273-8dde-59aa6e04360c on hv-cinder-85083 Aug 22 12:53:11.821555 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-9b67db34-e149-4d96-87b1-f933410570fe req-b5176b2e-f77d-421e-85b8-61341568005b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031037 Aug 22 12:53:11.822128 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 328/660] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:53:12.769227 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:12.769772 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:12.776061 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:12.776553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:12.776987 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:12.784375 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:12.784375 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:12.784375 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:12.811177 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:12.811656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:12.812093 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:12.812538 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lazy-loading 'fault' on Instance uuid 0f8c98b8-cca2-4273-8dde-59aa6e04360c {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:53:12.856760 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:12.864676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b83018e3-032c-4d2f-866b-bd228526f068 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 200 len: 1304 microversion: 2.1 time: 0.099507 Aug 22 12:53:12.866047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 333/661] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:12 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:53:13.887963 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:13.888874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: 0f8c98b8-cca2-4273-8dde-59aa6e04360c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:13.895131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:13.895623 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:13.896066 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:13.896815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:13.897279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:13.897706 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:13.910889 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] HTTP exception thrown: Instance 0f8c98b8-cca2-4273-8dde-59aa6e04360c could not be found. Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Request method failure captured: Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c HTTP/1.1 Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3whdJ0Rp40AcljnA28lJIaIP9RjDwhPmuVSrl0ANVe_HOg6bF803b8xpmu3J9P_Miw5RClrqs6E07sCLtOgVIoS8iYmG1ndgwd2kHm0spK7tkmAdj3nHQ12JqdnptnrZGbFY0H5mSa5nYGknlZuoXjAYtFVscZSQjNWBkC3scQB6jM Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 0fa7ab184f2d475899be14a15bf9cb42 Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-VolumesActionsTest-779492193 Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:53:13.912530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0fa7ab184f2d475899be14a15bf9cb42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0fa7ab184f2d475899be14a15bf9cb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0fa7ab184f2d475899be14a15bf9cb42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0fa7ab184f2d475899be14a15bf9cb42"}]}] Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-VolumesActionsTest-779492193 Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 0fa7ab184f2d475899be14a15bf9cb42 Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-VolumesActionsTest-779492193 Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-VolumesActionsTest-779492193-project Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 5c8054538c6f4e8ebb890075aa1b7283 Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-VolumesActionsTest-779492193-project Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 0f8c98b8-cca2-4273-8dde-59aa6e04360c could not be found. Aug 22 12:53:13.914004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '0f8c98b8-cca2-4273-8dde-59aa6e04360c'} Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f8c98b8-cca2-4273-8dde-59aa6e04360c could not be found. Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:13.915017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f8c98b8-cca2-4273-8dde-59aa6e04360c could not be found. Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f8c98b8-cca2-4273-8dde-59aa6e04360c could not be found. Aug 22 12:53:13.916599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:13.918874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Returning 404 to user: Instance 0f8c98b8-cca2-4273-8dde-59aa6e04360c could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:13.918874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-372e961a-09c8-4875-8007-f4fc15e46c5a tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c" status: 404 len: 111 microversion: 2.1 time: 0.030740 Aug 22 12:53:13.918874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 329/662] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:13 2022] GET /compute/v2.1/servers/0f8c98b8-cca2-4273-8dde-59aa6e04360c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:53:14.023041 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-989628597", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "networks": [{"uuid": "2cbd1d69-3ac7-4b6c-aff9-e48b78677f45"}]}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:14.076506 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] validate_networks() for [('2cbd1d69-3ac7-4b6c-aff9-e48b78677f45', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:53:14.594549 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:53:14.594977 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:53:14.595454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:53:14.595868 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:53:14.596279 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:53:14.606481 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:14.606967 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:14.607403 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:14.608138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:14.608597 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:14.609020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:14.625789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Getting quotas for project 0fa7ab184f2d475899be14a15bf9cb42. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:53:14.630409 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Getting quotas for user 5c8054538c6f4e8ebb890075aa1b7283 and project 0fa7ab184f2d475899be14a15bf9cb42. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:53:14.640968 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:53:14.643285 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:53:14.840956 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-28f85305-643b-426c-ac42-55dfac9fc1d3 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822578 Aug 22 12:53:14.841676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 334/663] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:53:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:53:14.852837 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6cb7bebc-85a8-4d10-8200-cc29fe6dbe19 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:14.853791 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6cb7bebc-85a8-4d10-8200-cc29fe6dbe19 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:14.917525 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6cb7bebc-85a8-4d10-8200-cc29fe6dbe19 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:14.926062 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6cb7bebc-85a8-4d10-8200-cc29fe6dbe19 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1213 microversion: 2.1 time: 0.077555 Aug 22 12:53:14.926677 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 330/664] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:14 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:15.960140 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a3567c30-9dc2-49e5-b748-44d58c100721 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:15.961290 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a3567c30-9dc2-49e5-b748-44d58c100721 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:15.968879 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3567c30-9dc2-49e5-b748-44d58c100721 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:15.969381 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3567c30-9dc2-49e5-b748-44d58c100721 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:15.969814 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3567c30-9dc2-49e5-b748-44d58c100721 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:15.970551 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3567c30-9dc2-49e5-b748-44d58c100721 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:15.971014 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3567c30-9dc2-49e5-b748-44d58c100721 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:15.971442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a3567c30-9dc2-49e5-b748-44d58c100721 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:16.044273 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a3567c30-9dc2-49e5-b748-44d58c100721 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:16.052853 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a3567c30-9dc2-49e5-b748-44d58c100721 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1217 microversion: 2.1 time: 0.109067 Aug 22 12:53:16.060307 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 335/665] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:15 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:17.073466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f754322f-56ed-43eb-9a42-eee1a45c0880 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:17.075304 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f754322f-56ed-43eb-9a42-eee1a45c0880 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:17.083297 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f754322f-56ed-43eb-9a42-eee1a45c0880 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:17.084039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f754322f-56ed-43eb-9a42-eee1a45c0880 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:17.084805 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f754322f-56ed-43eb-9a42-eee1a45c0880 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:17.086105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f754322f-56ed-43eb-9a42-eee1a45c0880 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:17.092660 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f754322f-56ed-43eb-9a42-eee1a45c0880 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:17.092660 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f754322f-56ed-43eb-9a42-eee1a45c0880 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:17.154325 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f754322f-56ed-43eb-9a42-eee1a45c0880 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:17.164531 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f754322f-56ed-43eb-9a42-eee1a45c0880 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1265 microversion: 2.1 time: 0.094757 Aug 22 12:53:17.178734 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 331/666] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:17 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:18.186323 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2259ab64-5690-498c-9e70-3692fe01d290 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:18.186934 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2259ab64-5690-498c-9e70-3692fe01d290 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:18.196928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2259ab64-5690-498c-9e70-3692fe01d290 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:18.198563 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2259ab64-5690-498c-9e70-3692fe01d290 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:18.203915 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2259ab64-5690-498c-9e70-3692fe01d290 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:18.205101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2259ab64-5690-498c-9e70-3692fe01d290 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:18.205811 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2259ab64-5690-498c-9e70-3692fe01d290 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:18.206029 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2259ab64-5690-498c-9e70-3692fe01d290 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:18.487332 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2259ab64-5690-498c-9e70-3692fe01d290 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:18.501135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2259ab64-5690-498c-9e70-3692fe01d290 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1313 microversion: 2.1 time: 0.318722 Aug 22 12:53:18.501727 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 336/667] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:18 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:19.334738 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-c72a26d0-62e7-4dfa-92d9-86cef5e7f098 req-0f383041-c2b8-4df0-8bfd-1ba03ffa4d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc595abf-d90a-45a8-b1d4-7f8b9a23ab56", "tag": "b172dcae-14bc-4297-966b-ff51d426644e"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:19.357953 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c72a26d0-62e7-4dfa-92d9-86cef5e7f098 req-0f383041-c2b8-4df0-8bfd-1ba03ffa4d84 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:19.358843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c72a26d0-62e7-4dfa-92d9-86cef5e7f098 req-0f383041-c2b8-4df0-8bfd-1ba03ffa4d84 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:19.359539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c72a26d0-62e7-4dfa-92d9-86cef5e7f098 req-0f383041-c2b8-4df0-8bfd-1ba03ffa4d84 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:19.386648 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-c72a26d0-62e7-4dfa-92d9-86cef5e7f098 req-0f383041-c2b8-4df0-8bfd-1ba03ffa4d84 service nova] Creating event network-changed:b172dcae-14bc-4297-966b-ff51d426644e for instance bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 on hv-cinder-85083 Aug 22 12:53:19.402852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-c72a26d0-62e7-4dfa-92d9-86cef5e7f098 req-0f383041-c2b8-4df0-8bfd-1ba03ffa4d84 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075693 Aug 22 12:53:19.403500 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 332/668] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:53:19.527605 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-982787ef-efde-4d0d-ade9-1f8f8cae6cba tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:19.529171 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-982787ef-efde-4d0d-ade9-1f8f8cae6cba tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:19.546935 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-982787ef-efde-4d0d-ade9-1f8f8cae6cba tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:19.548827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-982787ef-efde-4d0d-ade9-1f8f8cae6cba tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:19.548827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-982787ef-efde-4d0d-ade9-1f8f8cae6cba tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:19.549489 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-982787ef-efde-4d0d-ade9-1f8f8cae6cba tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:19.550152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-982787ef-efde-4d0d-ade9-1f8f8cae6cba tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:19.550836 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-982787ef-efde-4d0d-ade9-1f8f8cae6cba tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:19.751133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b53e1b49-3c5a-407a-b977-e62ca836c9fa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: .version_select at 0x7f7659c30f70>, body: {"keypair": {"name": "tempest-keypair-1535659742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4LbaoE3E77KBC4Jq46/62hUB1ewH8lGI3u/xgyRZNAiawYlsf09XOUFYn702uKRPlbLWFFduXlMf7BewArcP8PB5oAILnid8tstF5XGBK58vuPW154sBk16IDL7eruhg=="}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:19.768317 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-b53e1b49-3c5a-407a-b977-e62ca836c9fa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'key_pairs'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:53:19.773593 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-b53e1b49-3c5a-407a-b977-e62ca836c9fa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for user 74e80391b8814b44b13a6b38d36b15ee and project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'key_pairs'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:53:19.820829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-982787ef-efde-4d0d-ade9-1f8f8cae6cba tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:19.830908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-982787ef-efde-4d0d-ade9-1f8f8cae6cba tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1313 microversion: 2.1 time: 0.307301 Aug 22 12:53:19.831496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 337/669] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:19 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:19.860099 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b53e1b49-3c5a-407a-b977-e62ca836c9fa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.242191 Aug 22 12:53:19.860721 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 333/670] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 22 12:53:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:53:20.854220 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-cc47fb0c-0ed0-41e3-847a-a9071cf3d592 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:20.854948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-cc47fb0c-0ed0-41e3-847a-a9071cf3d592 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:20.861264 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc47fb0c-0ed0-41e3-847a-a9071cf3d592 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:20.861816 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc47fb0c-0ed0-41e3-847a-a9071cf3d592 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:20.862411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc47fb0c-0ed0-41e3-847a-a9071cf3d592 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:20.866201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc47fb0c-0ed0-41e3-847a-a9071cf3d592 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:20.866201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc47fb0c-0ed0-41e3-847a-a9071cf3d592 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:20.866201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc47fb0c-0ed0-41e3-847a-a9071cf3d592 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:20.997947 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-cc47fb0c-0ed0-41e3-847a-a9071cf3d592 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:21.006678 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-cc47fb0c-0ed0-41e3-847a-a9071cf3d592 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1313 microversion: 2.1 time: 0.157839 Aug 22 12:53:21.007255 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 338/671] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:20 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:22.028547 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-741720b7-e207-4683-8649-8500c6e9d4d2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:22.029370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-741720b7-e207-4683-8649-8500c6e9d4d2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:22.036090 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-741720b7-e207-4683-8649-8500c6e9d4d2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:22.036677 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-741720b7-e207-4683-8649-8500c6e9d4d2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:22.037706 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-741720b7-e207-4683-8649-8500c6e9d4d2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:22.041433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-741720b7-e207-4683-8649-8500c6e9d4d2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:22.042387 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-741720b7-e207-4683-8649-8500c6e9d4d2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:22.043153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-741720b7-e207-4683-8649-8500c6e9d4d2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:22.194280 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-741720b7-e207-4683-8649-8500c6e9d4d2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:22.202134 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-741720b7-e207-4683-8649-8500c6e9d4d2 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1313 microversion: 2.1 time: 0.178038 Aug 22 12:53:22.203057 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 334/672] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:22 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:22.376896 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1879584377", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45d598ec-3137-4425-8c25-3a2a4913d98a"}], "security_groups": [{"name": "tempest-securitygroup--738709450"}], "key_name": "tempest-keypair-1535659742", "user_data": "}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:22.513231 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] validate_networks() for [('45d598ec-3137-4425-8c25-3a2a4913d98a', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:53:22.921215 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:53:22.922024 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:53:22.922603 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:53:22.923018 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:53:22.923435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:53:22.933407 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:22.933902 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:22.934379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:22.935122 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:22.935586 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:22.936011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:22.953933 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:53:22.957973 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for user 74e80391b8814b44b13a6b38d36b15ee and project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:53:22.970156 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:53:22.972620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:53:23.112281 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-cc333ba6-74e6-4932-adcc-e61e78dccff7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.740537 Aug 22 12:53:23.113020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 339/673] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:53:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:53:23.124540 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0fd0660f-bb7c-499a-924a-db75dd5178fa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:23.125175 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0fd0660f-bb7c-499a-924a-db75dd5178fa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:23.128596 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:23.193080 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0fd0660f-bb7c-499a-924a-db75dd5178fa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:23.201635 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0fd0660f-bb7c-499a-924a-db75dd5178fa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1242 microversion: 2.1 time: 0.080881 Aug 22 12:53:23.202237 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 335/674] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:23 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:23.228415 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5183a4f4-8400-4959-b0f5-a839147ab212 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:23.229281 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-5183a4f4-8400-4959-b0f5-a839147ab212 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:23.238281 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5183a4f4-8400-4959-b0f5-a839147ab212 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:23.238800 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5183a4f4-8400-4959-b0f5-a839147ab212 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:23.239276 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5183a4f4-8400-4959-b0f5-a839147ab212 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:23.239999 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5183a4f4-8400-4959-b0f5-a839147ab212 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:23.240963 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5183a4f4-8400-4959-b0f5-a839147ab212 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:23.241682 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5183a4f4-8400-4959-b0f5-a839147ab212 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:23.389360 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-5183a4f4-8400-4959-b0f5-a839147ab212 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:23.397260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-5183a4f4-8400-4959-b0f5-a839147ab212 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1313 microversion: 2.1 time: 0.178340 Aug 22 12:53:23.397925 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 340/675] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:23 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:24.222498 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4fff11e3-289f-4e66-ab52-232346527853 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:24.223042 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4fff11e3-289f-4e66-ab52-232346527853 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:24.230813 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4fff11e3-289f-4e66-ab52-232346527853 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:24.234539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4fff11e3-289f-4e66-ab52-232346527853 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:24.234539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4fff11e3-289f-4e66-ab52-232346527853 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:24.234539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4fff11e3-289f-4e66-ab52-232346527853 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:24.234539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4fff11e3-289f-4e66-ab52-232346527853 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:24.234975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4fff11e3-289f-4e66-ab52-232346527853 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:24.296109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-4fff11e3-289f-4e66-ab52-232346527853 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:24.304539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4fff11e3-289f-4e66-ab52-232346527853 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1246 microversion: 2.1 time: 0.086054 Aug 22 12:53:24.307084 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 336/676] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:24 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:24.423482 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-23ea53b0-5788-4b27-9ed5-2068ee9333fe tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:24.424248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-23ea53b0-5788-4b27-9ed5-2068ee9333fe tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:24.431927 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ea53b0-5788-4b27-9ed5-2068ee9333fe tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:24.432413 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ea53b0-5788-4b27-9ed5-2068ee9333fe tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:24.432870 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ea53b0-5788-4b27-9ed5-2068ee9333fe tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:24.434156 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ea53b0-5788-4b27-9ed5-2068ee9333fe tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:24.434982 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ea53b0-5788-4b27-9ed5-2068ee9333fe tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:24.435431 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ea53b0-5788-4b27-9ed5-2068ee9333fe tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:24.571992 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-23ea53b0-5788-4b27-9ed5-2068ee9333fe tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:24.580104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-23ea53b0-5788-4b27-9ed5-2068ee9333fe tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1313 microversion: 2.1 time: 0.162048 Aug 22 12:53:24.580701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 341/677] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:24 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:24.660002 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-dd71a137-22ce-45ba-a5de-dee34f0a994e req-d4def0d1-969f-4e2b-aa94-c6d9f07126e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc595abf-d90a-45a8-b1d4-7f8b9a23ab56", "name": "network-vif-plugged", "status": "completed", "tag": "b172dcae-14bc-4297-966b-ff51d426644e"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:24.670172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-dd71a137-22ce-45ba-a5de-dee34f0a994e req-d4def0d1-969f-4e2b-aa94-c6d9f07126e1 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:24.670678 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-dd71a137-22ce-45ba-a5de-dee34f0a994e req-d4def0d1-969f-4e2b-aa94-c6d9f07126e1 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:24.671109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-dd71a137-22ce-45ba-a5de-dee34f0a994e req-d4def0d1-969f-4e2b-aa94-c6d9f07126e1 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:24.682274 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-dd71a137-22ce-45ba-a5de-dee34f0a994e req-d4def0d1-969f-4e2b-aa94-c6d9f07126e1 service nova] Creating event network-vif-plugged:b172dcae-14bc-4297-966b-ff51d426644e for instance bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 on hv-cinder-85083 Aug 22 12:53:24.687159 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-dd71a137-22ce-45ba-a5de-dee34f0a994e req-d4def0d1-969f-4e2b-aa94-c6d9f07126e1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031016 Aug 22 12:53:24.687721 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 337/678] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:53:25.325223 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9f97369f-3d8c-4eb4-9d69-6b8502f61754 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:25.325839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9f97369f-3d8c-4eb4-9d69-6b8502f61754 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:25.332874 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9f97369f-3d8c-4eb4-9d69-6b8502f61754 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:25.333301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9f97369f-3d8c-4eb4-9d69-6b8502f61754 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:25.334270 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9f97369f-3d8c-4eb4-9d69-6b8502f61754 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:25.334965 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9f97369f-3d8c-4eb4-9d69-6b8502f61754 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:25.335421 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9f97369f-3d8c-4eb4-9d69-6b8502f61754 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:25.335846 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9f97369f-3d8c-4eb4-9d69-6b8502f61754 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:25.397000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-9f97369f-3d8c-4eb4-9d69-6b8502f61754 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:25.404625 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9f97369f-3d8c-4eb4-9d69-6b8502f61754 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1294 microversion: 2.1 time: 0.083360 Aug 22 12:53:25.405191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 342/679] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:25 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:25.602363 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b6e4eb36-8d43-4c8b-862d-f5e39cb383c0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:25.602998 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b6e4eb36-8d43-4c8b-862d-f5e39cb383c0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:25.609389 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6e4eb36-8d43-4c8b-862d-f5e39cb383c0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:25.609875 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6e4eb36-8d43-4c8b-862d-f5e39cb383c0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:25.610353 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6e4eb36-8d43-4c8b-862d-f5e39cb383c0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:25.611065 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6e4eb36-8d43-4c8b-862d-f5e39cb383c0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:25.611503 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6e4eb36-8d43-4c8b-862d-f5e39cb383c0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:25.611929 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b6e4eb36-8d43-4c8b-862d-f5e39cb383c0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:25.747793 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b6e4eb36-8d43-4c8b-862d-f5e39cb383c0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:25.755366 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b6e4eb36-8d43-4c8b-862d-f5e39cb383c0 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1313 microversion: 2.1 time: 0.157779 Aug 22 12:53:25.756524 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 338/680] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:25 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:26.426047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-4520a875-32ef-4e3a-907d-8168a3bab9b4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:26.427196 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-4520a875-32ef-4e3a-907d-8168a3bab9b4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:26.437232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4520a875-32ef-4e3a-907d-8168a3bab9b4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:26.444508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4520a875-32ef-4e3a-907d-8168a3bab9b4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:26.444508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4520a875-32ef-4e3a-907d-8168a3bab9b4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:26.444508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4520a875-32ef-4e3a-907d-8168a3bab9b4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:26.444508 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4520a875-32ef-4e3a-907d-8168a3bab9b4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:26.444924 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4520a875-32ef-4e3a-907d-8168a3bab9b4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:26.496453 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-52fdb0ae-f188-498e-86ff-11eb8f81a88f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:26.498612 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-52fdb0ae-f188-498e-86ff-11eb8f81a88f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:26.504355 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-52fdb0ae-f188-498e-86ff-11eb8f81a88f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:26.504844 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-52fdb0ae-f188-498e-86ff-11eb8f81a88f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:26.505280 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-52fdb0ae-f188-498e-86ff-11eb8f81a88f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:26.506004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-52fdb0ae-f188-498e-86ff-11eb8f81a88f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:26.506488 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-52fdb0ae-f188-498e-86ff-11eb8f81a88f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:26.506910 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-52fdb0ae-f188-498e-86ff-11eb8f81a88f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:26.533447 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4520a875-32ef-4e3a-907d-8168a3bab9b4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:26.537911 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-52fdb0ae-f188-498e-86ff-11eb8f81a88f tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044398 Aug 22 12:53:26.542311 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-4520a875-32ef-4e3a-907d-8168a3bab9b4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1302 microversion: 2.1 time: 0.120389 Aug 22 12:53:26.543113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 343/681] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:26 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1302 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:26.543906 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 339/682] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 22 12:53:26 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:53:26.598746 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a2ba9ada-c2a8-4599-b329-81f7e588e0c9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:26.599809 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a2ba9ada-c2a8-4599-b329-81f7e588e0c9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:26.605967 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a2ba9ada-c2a8-4599-b329-81f7e588e0c9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:26.610100 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a2ba9ada-c2a8-4599-b329-81f7e588e0c9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:26.610100 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a2ba9ada-c2a8-4599-b329-81f7e588e0c9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:26.610100 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a2ba9ada-c2a8-4599-b329-81f7e588e0c9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:26.610100 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a2ba9ada-c2a8-4599-b329-81f7e588e0c9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:26.610476 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a2ba9ada-c2a8-4599-b329-81f7e588e0c9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:26.632248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a2ba9ada-c2a8-4599-b329-81f7e588e0c9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:53:26.645425 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=100 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:26.777089 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4b654a29-5ffe-48f8-8c8c-43d847a4407b tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:26.777699 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4b654a29-5ffe-48f8-8c8c-43d847a4407b tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:26.783975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4b654a29-5ffe-48f8-8c8c-43d847a4407b tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:26.784459 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4b654a29-5ffe-48f8-8c8c-43d847a4407b tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:26.784893 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4b654a29-5ffe-48f8-8c8c-43d847a4407b tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:26.785579 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4b654a29-5ffe-48f8-8c8c-43d847a4407b tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:26.786034 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4b654a29-5ffe-48f8-8c8c-43d847a4407b tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:26.786481 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4b654a29-5ffe-48f8-8c8c-43d847a4407b tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:26.943526 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a2ba9ada-c2a8-4599-b329-81f7e588e0c9 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "DELETE /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 204 len: 0 microversion: 2.20 time: 0.347804 Aug 22 12:53:26.947891 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 344/683] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 22 12:53:26 2022] DELETE /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 12:53:26.953375 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:26.954257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:26.960745 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:26.961235 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:26.961665 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:26.962458 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:26.962919 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:26.963343 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:26.974784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-4b654a29-5ffe-48f8-8c8c-43d847a4407b tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:26.984001 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4b654a29-5ffe-48f8-8c8c-43d847a4407b tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1497 microversion: 2.1 time: 0.210739 Aug 22 12:53:26.984579 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 340/684] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:26 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:53:27.105021 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:27.113299 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:27.114837 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:27.116204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-675f6e79-630f-48e8-a09e-3f3b18eb0559 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.166944 Aug 22 12:53:27.116796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 345/685] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:53:26 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:53:27.565465 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e284486d-83ff-48b9-904b-f0ce99d06e53 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:27.566079 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e284486d-83ff-48b9-904b-f0ce99d06e53 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:27.572719 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e284486d-83ff-48b9-904b-f0ce99d06e53 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:27.573211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e284486d-83ff-48b9-904b-f0ce99d06e53 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:27.573651 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e284486d-83ff-48b9-904b-f0ce99d06e53 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:27.575529 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e284486d-83ff-48b9-904b-f0ce99d06e53 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:27.575529 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e284486d-83ff-48b9-904b-f0ce99d06e53 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:27.575529 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e284486d-83ff-48b9-904b-f0ce99d06e53 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:27.640461 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e284486d-83ff-48b9-904b-f0ce99d06e53 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:27.648181 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e284486d-83ff-48b9-904b-f0ce99d06e53 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1312 microversion: 2.1 time: 0.086557 Aug 22 12:53:27.648760 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 341/686] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:27 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1312 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:27.988369 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-fae1cb2d-8a59-4d5a-9898-28502a637fc1 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:27.988882 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-fae1cb2d-8a59-4d5a-9898-28502a637fc1 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:27.994944 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fae1cb2d-8a59-4d5a-9898-28502a637fc1 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:27.995422 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fae1cb2d-8a59-4d5a-9898-28502a637fc1 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:27.995856 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fae1cb2d-8a59-4d5a-9898-28502a637fc1 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:27.996535 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fae1cb2d-8a59-4d5a-9898-28502a637fc1 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:27.996990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fae1cb2d-8a59-4d5a-9898-28502a637fc1 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:27.997409 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fae1cb2d-8a59-4d5a-9898-28502a637fc1 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:28.025320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-fae1cb2d-8a59-4d5a-9898-28502a637fc1 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:53:28.138927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:28.139544 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:28.145875 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:28.146898 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:28.147341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:28.148039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:28.148498 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:28.148999 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:28.294408 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:28.303609 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:28.307476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:28.307476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-098886a0-8a6f-4653-85c1-cb52427106db tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.171584 Aug 22 12:53:28.307476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 342/687] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:53:28 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 12:53:28.331176 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-fae1cb2d-8a59-4d5a-9898-28502a637fc1 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 204 len: 0 microversion: 2.1 time: 0.346311 Aug 22 12:53:28.331776 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 346/688] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:53:27 2022] DELETE /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:53:28.340413 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-9a8c72f0-aea3-43ec-9052-18591f66baff tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:28.341029 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-9a8c72f0-aea3-43ec-9052-18591f66baff tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:28.350127 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9a8c72f0-aea3-43ec-9052-18591f66baff tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:28.350717 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9a8c72f0-aea3-43ec-9052-18591f66baff tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:28.351274 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9a8c72f0-aea3-43ec-9052-18591f66baff tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:28.352001 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9a8c72f0-aea3-43ec-9052-18591f66baff tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:28.352525 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9a8c72f0-aea3-43ec-9052-18591f66baff tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:28.352945 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9a8c72f0-aea3-43ec-9052-18591f66baff tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:28.549490 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9a8c72f0-aea3-43ec-9052-18591f66baff tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:28.557202 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-9a8c72f0-aea3-43ec-9052-18591f66baff tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1503 microversion: 2.1 time: 0.220533 Aug 22 12:53:28.557954 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 343/689] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:28 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:28.669610 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-268ef075-cff7-4ef5-998e-9131e4cc945c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:28.670359 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-268ef075-cff7-4ef5-998e-9131e4cc945c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:28.676234 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-268ef075-cff7-4ef5-998e-9131e4cc945c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:28.676721 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-268ef075-cff7-4ef5-998e-9131e4cc945c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:28.677149 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-268ef075-cff7-4ef5-998e-9131e4cc945c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:28.678578 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-268ef075-cff7-4ef5-998e-9131e4cc945c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:28.679125 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-268ef075-cff7-4ef5-998e-9131e4cc945c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:28.679573 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-268ef075-cff7-4ef5-998e-9131e4cc945c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:28.975780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-268ef075-cff7-4ef5-998e-9131e4cc945c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:28.983837 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-268ef075-cff7-4ef5-998e-9131e4cc945c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1300 microversion: 2.1 time: 0.318484 Aug 22 12:53:28.984546 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 347/690] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:28 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1300 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:29.331180 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:29.331786 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:29.338211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:29.338712 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:29.339148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:29.339845 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:29.340295 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:29.340722 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:29.470530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:29.479336 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:29.480862 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:29.482013 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-edf5e10e-3b57-4c5a-a14b-0486a1edf41b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1724 microversion: 2.20 time: 0.154989 Aug 22 12:53:29.482598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 344/691] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:53:29 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:53:29.578232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1cff00c6-d990-4535-83c6-c6e14d51f481 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:29.578998 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1cff00c6-d990-4535-83c6-c6e14d51f481 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:29.585911 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cff00c6-d990-4535-83c6-c6e14d51f481 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:29.589534 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cff00c6-d990-4535-83c6-c6e14d51f481 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:29.589534 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cff00c6-d990-4535-83c6-c6e14d51f481 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:29.589534 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cff00c6-d990-4535-83c6-c6e14d51f481 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:29.589534 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cff00c6-d990-4535-83c6-c6e14d51f481 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:29.589839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cff00c6-d990-4535-83c6-c6e14d51f481 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:29.806710 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1cff00c6-d990-4535-83c6-c6e14d51f481 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:29.815661 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1cff00c6-d990-4535-83c6-c6e14d51f481 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1503 microversion: 2.1 time: 0.241376 Aug 22 12:53:29.816824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 348/692] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:29 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1503 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:30.005251 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7ab4fc4d-b7d6-4a69-a011-99e070243464 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:30.006174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7ab4fc4d-b7d6-4a69-a011-99e070243464 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:30.012586 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ab4fc4d-b7d6-4a69-a011-99e070243464 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:30.013511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ab4fc4d-b7d6-4a69-a011-99e070243464 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:30.014080 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ab4fc4d-b7d6-4a69-a011-99e070243464 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:30.014829 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ab4fc4d-b7d6-4a69-a011-99e070243464 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:30.015296 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ab4fc4d-b7d6-4a69-a011-99e070243464 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:30.016011 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ab4fc4d-b7d6-4a69-a011-99e070243464 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:30.243096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7ab4fc4d-b7d6-4a69-a011-99e070243464 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:30.251894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7ab4fc4d-b7d6-4a69-a011-99e070243464 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1367 microversion: 2.1 time: 0.250556 Aug 22 12:53:30.253826 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 345/693] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:29 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:30.412749 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-49ea871c-8613-4fb0-b22e-fc336ee35a0a req-c7bb9ccb-9a02-4a2a-a059-3868d2fba73a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746985f5-95e3-4ad2-a997-67653768dfd3", "tag": "21b63d76-4db0-4418-9307-fd5e2193ad9d"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:30.422484 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-49ea871c-8613-4fb0-b22e-fc336ee35a0a req-c7bb9ccb-9a02-4a2a-a059-3868d2fba73a service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:30.423051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-49ea871c-8613-4fb0-b22e-fc336ee35a0a req-c7bb9ccb-9a02-4a2a-a059-3868d2fba73a service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:30.423598 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-49ea871c-8613-4fb0-b22e-fc336ee35a0a req-c7bb9ccb-9a02-4a2a-a059-3868d2fba73a service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:30.435173 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-49ea871c-8613-4fb0-b22e-fc336ee35a0a req-c7bb9ccb-9a02-4a2a-a059-3868d2fba73a service nova] Creating event network-changed:21b63d76-4db0-4418-9307-fd5e2193ad9d for instance 746985f5-95e3-4ad2-a997-67653768dfd3 on hv-cinder-85083 Aug 22 12:53:30.440184 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-49ea871c-8613-4fb0-b22e-fc336ee35a0a req-c7bb9ccb-9a02-4a2a-a059-3868d2fba73a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032356 Aug 22 12:53:30.447468 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 349/694] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:53:30.504954 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:30.505631 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:30.512057 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:30.512550 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:30.513267 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:30.514150 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:30.515260 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:30.515704 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:30.607574 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:30.617789 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:30.619369 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:30.620598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-91f99782-1013-45c2-bcc0-c88186ade323 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1656 microversion: 2.20 time: 0.119610 Aug 22 12:53:30.624463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 346/695] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:53:30 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1656 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:53:30.784583 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-62656ac8-a7f1-4b46-ab82-7cdb9cda24cd req-1f1181ea-6106-4fee-aaaa-56db173aba70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc595abf-d90a-45a8-b1d4-7f8b9a23ab56", "name": "network-vif-deleted", "tag": "b172dcae-14bc-4297-966b-ff51d426644e"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:30.797982 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-62656ac8-a7f1-4b46-ab82-7cdb9cda24cd req-1f1181ea-6106-4fee-aaaa-56db173aba70 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:30.806408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-62656ac8-a7f1-4b46-ab82-7cdb9cda24cd req-1f1181ea-6106-4fee-aaaa-56db173aba70 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:30.808606 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-62656ac8-a7f1-4b46-ab82-7cdb9cda24cd req-1f1181ea-6106-4fee-aaaa-56db173aba70 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:30.820271 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-62656ac8-a7f1-4b46-ab82-7cdb9cda24cd req-1f1181ea-6106-4fee-aaaa-56db173aba70 service nova] Creating event network-vif-deleted:b172dcae-14bc-4297-966b-ff51d426644e for instance bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 on hv-cinder-85083 Aug 22 12:53:30.825115 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-62656ac8-a7f1-4b46-ab82-7cdb9cda24cd req-1f1181ea-6106-4fee-aaaa-56db173aba70 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046245 Aug 22 12:53:30.826074 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 350/696] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:53:30.837549 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-20598fef-b77b-4ae9-84fd-c16d75adf96c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:30.839448 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-20598fef-b77b-4ae9-84fd-c16d75adf96c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:30.845828 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20598fef-b77b-4ae9-84fd-c16d75adf96c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:30.854458 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20598fef-b77b-4ae9-84fd-c16d75adf96c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:30.854458 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20598fef-b77b-4ae9-84fd-c16d75adf96c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:30.854458 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20598fef-b77b-4ae9-84fd-c16d75adf96c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:30.854458 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20598fef-b77b-4ae9-84fd-c16d75adf96c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:30.855276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-20598fef-b77b-4ae9-84fd-c16d75adf96c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:30.932699 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-20598fef-b77b-4ae9-84fd-c16d75adf96c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:30.947062 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-20598fef-b77b-4ae9-84fd-c16d75adf96c tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1461 microversion: 2.1 time: 0.113730 Aug 22 12:53:30.962127 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 347/697] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:30 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1461 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:31.273070 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3229d78e-7ca8-4b9e-8b6d-83e08af3cb97 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:31.273909 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-3229d78e-7ca8-4b9e-8b6d-83e08af3cb97 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:31.280278 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3229d78e-7ca8-4b9e-8b6d-83e08af3cb97 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:31.280771 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3229d78e-7ca8-4b9e-8b6d-83e08af3cb97 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:31.281213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3229d78e-7ca8-4b9e-8b6d-83e08af3cb97 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:31.281920 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3229d78e-7ca8-4b9e-8b6d-83e08af3cb97 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:31.282446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3229d78e-7ca8-4b9e-8b6d-83e08af3cb97 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:31.287535 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3229d78e-7ca8-4b9e-8b6d-83e08af3cb97 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:31.421178 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3229d78e-7ca8-4b9e-8b6d-83e08af3cb97 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:31.428916 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-3229d78e-7ca8-4b9e-8b6d-83e08af3cb97 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1367 microversion: 2.1 time: 0.160352 Aug 22 12:53:31.429497 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 351/698] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:31 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:31.644677 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:31.645862 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:31.661339 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:31.661339 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:31.661339 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:31.661339 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:31.661678 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:31.661678 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:31.680241 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:31.694685 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:31.698073 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:31.698073 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:31.698073 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lazy-loading 'fault' on Instance uuid 046710c4-dec2-4279-ab3f-297f3b5ba849 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:53:31.740159 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:31.748074 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:31.749556 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:31.750743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d00f1ba8-8bb8-4ab8-897e-0cfa88280971 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1371 microversion: 2.20 time: 0.110054 Aug 22 12:53:31.751293 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 348/699] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:53:31 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:53:31.968807 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:31.969496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:31.976053 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:31.980884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:31.980884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:31.980884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:31.980884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:31.981253 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:32.009495 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:32.010030 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:32.010502 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:32.010944 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lazy-loading 'fault' on Instance uuid bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:53:32.050772 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8054538c6f4e8ebb890075aa1b7283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa7ab184f2d475899be14a15bf9cb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:32.058938 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-551cf89f-405a-4a18-969d-04d28194bf82 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 200 len: 1303 microversion: 2.1 time: 0.093946 Aug 22 12:53:32.061041 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 352/700] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:31 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:32.449672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-79759932-39e4-45bc-9aec-26fa5716d3c9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:32.450211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-79759932-39e4-45bc-9aec-26fa5716d3c9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:32.456400 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79759932-39e4-45bc-9aec-26fa5716d3c9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:32.456872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79759932-39e4-45bc-9aec-26fa5716d3c9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:32.457299 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79759932-39e4-45bc-9aec-26fa5716d3c9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:32.457976 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79759932-39e4-45bc-9aec-26fa5716d3c9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:32.458947 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79759932-39e4-45bc-9aec-26fa5716d3c9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:32.474811 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79759932-39e4-45bc-9aec-26fa5716d3c9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:32.592550 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-79759932-39e4-45bc-9aec-26fa5716d3c9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:32.600802 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-79759932-39e4-45bc-9aec-26fa5716d3c9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1367 microversion: 2.1 time: 0.155363 Aug 22 12:53:32.601368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 349/701] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:32 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:32.774881 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:32.775501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:32.781488 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:32.782059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:32.782544 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:32.783262 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:32.783726 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:32.784157 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:32.828285 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:32.829099 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:32.829643 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:32.830397 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lazy-loading 'fault' on Instance uuid 046710c4-dec2-4279-ab3f-297f3b5ba849 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:53:32.866051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-5de8dd00-0ae5-4bd1-8da6-6eebbe4a1d16 req-3eb3ab73-50b9-4def-9267-dbbb17f26438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046710c4-dec2-4279-ab3f-297f3b5ba849", "name": "network-vif-deleted", "tag": "36a57df9-56c9-4cce-82c6-813a9eb66d52"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:32.876827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:32.881368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-5de8dd00-0ae5-4bd1-8da6-6eebbe4a1d16 req-3eb3ab73-50b9-4def-9267-dbbb17f26438 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:32.881999 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-5de8dd00-0ae5-4bd1-8da6-6eebbe4a1d16 req-3eb3ab73-50b9-4def-9267-dbbb17f26438 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:32.882827 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-5de8dd00-0ae5-4bd1-8da6-6eebbe4a1d16 req-3eb3ab73-50b9-4def-9267-dbbb17f26438 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:32.886094 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:32.887729 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36a40c9d61174c38b007ba0a30fc95c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97408eeab80e45f9a27c405c23038f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:32.888877 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f25002ca-a793-4142-ae5d-01cd89014a55 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 200 len: 1371 microversion: 2.20 time: 0.118550 Aug 22 12:53:32.889551 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 353/702] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:53:32 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 12:53:32.895782 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-5de8dd00-0ae5-4bd1-8da6-6eebbe4a1d16 req-3eb3ab73-50b9-4def-9267-dbbb17f26438 service nova] Creating event network-vif-deleted:36a57df9-56c9-4cce-82c6-813a9eb66d52 for instance 046710c4-dec2-4279-ab3f-297f3b5ba849 on hv-cinder-85083 Aug 22 12:53:32.901283 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-5de8dd00-0ae5-4bd1-8da6-6eebbe4a1d16 req-3eb3ab73-50b9-4def-9267-dbbb17f26438 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039065 Aug 22 12:53:32.901868 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 350/703] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:53:33.080363 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:33.081019 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] [instance: bc595abf-d90a-45a8-b1d4-7f8b9a23ab56] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:33.082975 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=4 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:33.084181 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=12 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:33.089349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:33.089879 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:33.090331 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:33.091016 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:33.091466 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:33.091884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:33.108205 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] HTTP exception thrown: Instance bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 could not be found. Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Request method failure captured: Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 HTTP/1.1 Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3whdJ0Rp40AcljnA28lJIaIP9RjDwhPmuVSrl0ANVe_HOg6bF803b8xpmu3J9P_Miw5RClrqs6E07sCLtOgVIoS8iYmG1ndgwd2kHm0spK7tkmAdj3nHQ12JqdnptnrZGbFY0H5mSa5nYGknlZuoXjAYtFVscZSQjNWBkC3scQB6jM Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 0fa7ab184f2d475899be14a15bf9cb42 Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-VolumesActionsTest-779492193 Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:53:33.111272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0fa7ab184f2d475899be14a15bf9cb42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0fa7ab184f2d475899be14a15bf9cb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0fa7ab184f2d475899be14a15bf9cb42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0fa7ab184f2d475899be14a15bf9cb42"}]}] Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-VolumesActionsTest-779492193 Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 0fa7ab184f2d475899be14a15bf9cb42 Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-VolumesActionsTest-779492193 Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-VolumesActionsTest-779492193-project Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 5c8054538c6f4e8ebb890075aa1b7283 Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-VolumesActionsTest-779492193-project Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 could not be found. Aug 22 12:53:33.118418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': 'bc595abf-d90a-45a8-b1d4-7f8b9a23ab56'} Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 could not be found. Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:33.119301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 could not be found. Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 could not be found. Aug 22 12:53:33.120742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:33.122275 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] Returning 404 to user: Instance bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:33.122275 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6af45870-222b-46ca-87f6-b34bedc97623 tempest-VolumesActionsTest-779492193 tempest-VolumesActionsTest-779492193-project] 10.222.0.15 "GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56" status: 404 len: 111 microversion: 2.1 time: 0.036891 Aug 22 12:53:33.122275 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 354/704] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:33 2022] GET /compute/v2.1/servers/bc595abf-d90a-45a8-b1d4-7f8b9a23ab56 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:53:33.619094 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=8 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:33.623210 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-556a6bcf-40a4-4dc6-ab5a-3b98333eb04a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:33.623910 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-556a6bcf-40a4-4dc6-ab5a-3b98333eb04a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:33.629835 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-556a6bcf-40a4-4dc6-ab5a-3b98333eb04a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:33.631637 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-556a6bcf-40a4-4dc6-ab5a-3b98333eb04a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:33.631637 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-556a6bcf-40a4-4dc6-ab5a-3b98333eb04a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:33.631637 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-556a6bcf-40a4-4dc6-ab5a-3b98333eb04a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:33.631974 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-556a6bcf-40a4-4dc6-ab5a-3b98333eb04a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:33.632406 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-556a6bcf-40a4-4dc6-ab5a-3b98333eb04a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:33.759819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-556a6bcf-40a4-4dc6-ab5a-3b98333eb04a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:33.767408 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-556a6bcf-40a4-4dc6-ab5a-3b98333eb04a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1367 microversion: 2.1 time: 0.149268 Aug 22 12:53:33.767977 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 351/705] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:33 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:33.912232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:33.912878 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:33.916285 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:33.920344 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:33.920828 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:33.921330 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:33.922022 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:33.922506 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:33.931809 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:33.936745 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] HTTP exception thrown: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Request method failure captured: Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 HTTP/1.1 Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3rMcZSP9JUKenJrkwBoxOVJGH3juPapNOcsn6t91niRv_nTVY-ijKlWumABEAqVeIu_Y8XAzBGxnehumtXNvrsOVNBI9LXaAByOlvqX-XUccfbMeVqEqKvAz9zD8UAi7W3H1szQO5_PLJeUdohlE2_saLDATCAzuEIA3vLw5GSVZI8 Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:53:33.938282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/97408eeab80e45f9a27c405c23038f8c"}]}] Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 36a40c9d61174c38b007ba0a30fc95c3 Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:33.939950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '046710c4-dec2-4279-ab3f-297f3b5ba849'} Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:33.940994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:33.942676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:33.944216 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Returning 404 to user: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:33.944216 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e401c4f0-92d1-46bd-b48c-b48b68d69ced tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 404 len: 111 microversion: 2.20 time: 0.031790 Aug 22 12:53:33.944216 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 355/706] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:53:33 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 12:53:33.949076 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0f7427c3-d099-4433-b36e-128aed2eb0c2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '.version_select at 0x7f7659c1f040>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:34.051800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0f7427c3-d099-4433-b36e-128aed2eb0c2 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365433334" status: 204 len: 0 microversion: 2.20 time: 0.106829 Aug 22 12:53:34.052409 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 352/707] 10.222.0.15 () {60 vars in 1262 bytes} [Mon Aug 22 12:53:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365433334 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 12:53:34.788630 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-336bc369-eebf-4ba8-a5bb-20d01479337f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:34.789245 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-336bc369-eebf-4ba8-a5bb-20d01479337f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:34.797028 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-336bc369-eebf-4ba8-a5bb-20d01479337f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:34.801435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-336bc369-eebf-4ba8-a5bb-20d01479337f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:34.801435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-336bc369-eebf-4ba8-a5bb-20d01479337f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:34.801435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-336bc369-eebf-4ba8-a5bb-20d01479337f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:34.801435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-336bc369-eebf-4ba8-a5bb-20d01479337f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:34.801877 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-336bc369-eebf-4ba8-a5bb-20d01479337f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:34.936152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-336bc369-eebf-4ba8-a5bb-20d01479337f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:34.945373 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-336bc369-eebf-4ba8-a5bb-20d01479337f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1367 microversion: 2.1 time: 0.160671 Aug 22 12:53:34.945678 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 356/708] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:34 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:35.975183 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f77b3d5d-a5ca-47d3-91c4-7adb90585e78 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:35.975701 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f77b3d5d-a5ca-47d3-91c4-7adb90585e78 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:35.982624 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77b3d5d-a5ca-47d3-91c4-7adb90585e78 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:35.983116 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77b3d5d-a5ca-47d3-91c4-7adb90585e78 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:35.983551 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77b3d5d-a5ca-47d3-91c4-7adb90585e78 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:35.984245 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77b3d5d-a5ca-47d3-91c4-7adb90585e78 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:35.984705 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77b3d5d-a5ca-47d3-91c4-7adb90585e78 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:35.985136 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f77b3d5d-a5ca-47d3-91c4-7adb90585e78 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:36.109658 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f77b3d5d-a5ca-47d3-91c4-7adb90585e78 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:36.117785 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f77b3d5d-a5ca-47d3-91c4-7adb90585e78 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1367 microversion: 2.1 time: 0.147698 Aug 22 12:53:36.118450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 353/709] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:35 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:37.137395 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d5cd0fa1-f288-48d5-9bc3-52f13d37f62b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:37.138007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-d5cd0fa1-f288-48d5-9bc3-52f13d37f62b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:37.144403 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5cd0fa1-f288-48d5-9bc3-52f13d37f62b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:37.144882 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5cd0fa1-f288-48d5-9bc3-52f13d37f62b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:37.145313 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5cd0fa1-f288-48d5-9bc3-52f13d37f62b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:37.146522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5cd0fa1-f288-48d5-9bc3-52f13d37f62b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:37.146977 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5cd0fa1-f288-48d5-9bc3-52f13d37f62b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:37.147398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5cd0fa1-f288-48d5-9bc3-52f13d37f62b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:37.276183 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d5cd0fa1-f288-48d5-9bc3-52f13d37f62b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:37.283775 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d5cd0fa1-f288-48d5-9bc3-52f13d37f62b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1367 microversion: 2.1 time: 0.150189 Aug 22 12:53:37.284343 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 357/710] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:37 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:38.280690 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:38.281196 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:38.287917 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:38.288482 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:38.289567 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:38.290118 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:38.290599 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:38.291024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:38.304724 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] HTTP exception thrown: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:38.305376 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ddac52df-7614-462e-9826-d3eac507dd87 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:38.306040 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ddac52df-7614-462e-9826-d3eac507dd87 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Request method failure captured: Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: DELETE /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 HTTP/1.1 Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rMcZSP9JUKenJrkwBoxOVJGH3juPapNOcsn6t91niRv_nTVY-ijKlWumABEAqVeIu_Y8XAzBGxnehumtXNvrsOVNBI9LXaAByOlvqX-XUccfbMeVqEqKvAz9zD8UAi7W3H1szQO5_PLJeUdohlE2_saLDATCAzuEIA3vLw5GSVZI8 Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:53:38.306962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/97408eeab80e45f9a27c405c23038f8c"}]}] Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 36a40c9d61174c38b007ba0a30fc95c3 Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:38.308286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '046710c4-dec2-4279-ab3f-297f3b5ba849'} Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:38.308996 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:38.310223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:38.317259 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Returning 404 to user: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:38.317259 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-23ee7380-6102-453d-b1c9-4a0ac290ccd0 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "DELETE /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 404 len: 111 microversion: 2.20 time: 0.031679 Aug 22 12:53:38.317259 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 354/711] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 22 12:53:38 2022] DELETE /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 12:53:38.317501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ddac52df-7614-462e-9826-d3eac507dd87 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:38.317501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ddac52df-7614-462e-9826-d3eac507dd87 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:38.317501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ddac52df-7614-462e-9826-d3eac507dd87 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:38.317501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ddac52df-7614-462e-9826-d3eac507dd87 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:38.317827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ddac52df-7614-462e-9826-d3eac507dd87 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:38.317827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ddac52df-7614-462e-9826-d3eac507dd87 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:38.317989 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:38.317989 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 046710c4-dec2-4279-ab3f-297f3b5ba849] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:38.323009 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:38.323497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:38.323937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:38.324628 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:38.325089 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:38.325523 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:38.338782 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] HTTP exception thrown: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Request method failure captured: Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 HTTP/1.1 Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rMcZSP9JUKenJrkwBoxOVJGH3juPapNOcsn6t91niRv_nTVY-ijKlWumABEAqVeIu_Y8XAzBGxnehumtXNvrsOVNBI9LXaAByOlvqX-XUccfbMeVqEqKvAz9zD8UAi7W3H1szQO5_PLJeUdohlE2_saLDATCAzuEIA3vLw5GSVZI8 Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:53:38.340306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/97408eeab80e45f9a27c405c23038f8c"}]}] Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 36a40c9d61174c38b007ba0a30fc95c3 Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:38.342059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '046710c4-dec2-4279-ab3f-297f3b5ba849'} Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:38.342981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. Aug 22 12:53:38.344466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:38.345933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Returning 404 to user: Instance 046710c4-dec2-4279-ab3f-297f3b5ba849 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:38.345933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c94b6a1e-834c-4d90-be5e-b05ab514e9e4 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849" status: 404 len: 111 microversion: 2.20 time: 0.028752 Aug 22 12:53:38.345933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 355/712] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:53:38 2022] GET /compute/v2.1/servers/046710c4-dec2-4279-ab3f-297f3b5ba849 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 12:53:38.450443 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ddac52df-7614-462e-9826-d3eac507dd87 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:38.458537 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ddac52df-7614-462e-9826-d3eac507dd87 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1367 microversion: 2.1 time: 0.157345 Aug 22 12:53:38.459118 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 358/713] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:38 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:53:39.482976 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-aa67691f-6333-4043-b74a-a76a1b6bb634 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:39.484203 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-aa67691f-6333-4043-b74a-a76a1b6bb634 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:39.492552 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa67691f-6333-4043-b74a-a76a1b6bb634 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:39.493496 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa67691f-6333-4043-b74a-a76a1b6bb634 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:39.494324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa67691f-6333-4043-b74a-a76a1b6bb634 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:39.495266 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa67691f-6333-4043-b74a-a76a1b6bb634 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:39.495932 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa67691f-6333-4043-b74a-a76a1b6bb634 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:39.496547 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-aa67691f-6333-4043-b74a-a76a1b6bb634 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:39.670823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-aa67691f-6333-4043-b74a-a76a1b6bb634 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:39.680143 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-aa67691f-6333-4043-b74a-a76a1b6bb634 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1367 microversion: 2.1 time: 0.203576 Aug 22 12:53:39.694004 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 356/714] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:39 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:39.704348 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-de70dd10-7771-4cf3-a878-b47247fd583b req-d6f3c664-2541-4610-b3b2-cb11cdcc7818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746985f5-95e3-4ad2-a997-67653768dfd3", "name": "network-vif-plugged", "status": "completed", "tag": "21b63d76-4db0-4418-9307-fd5e2193ad9d"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:39.723517 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-de70dd10-7771-4cf3-a878-b47247fd583b req-d6f3c664-2541-4610-b3b2-cb11cdcc7818 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:39.724411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-de70dd10-7771-4cf3-a878-b47247fd583b req-d6f3c664-2541-4610-b3b2-cb11cdcc7818 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:39.724938 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-de70dd10-7771-4cf3-a878-b47247fd583b req-d6f3c664-2541-4610-b3b2-cb11cdcc7818 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:39.730058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:39.731017 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:39.737283 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-de70dd10-7771-4cf3-a878-b47247fd583b req-d6f3c664-2541-4610-b3b2-cb11cdcc7818 service nova] Creating event network-vif-plugged:21b63d76-4db0-4418-9307-fd5e2193ad9d for instance 746985f5-95e3-4ad2-a997-67653768dfd3 on hv-cinder-85083 Aug 22 12:53:39.742799 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-de70dd10-7771-4cf3-a878-b47247fd583b req-d6f3c664-2541-4610-b3b2-cb11cdcc7818 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053736 Aug 22 12:53:39.743864 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 359/715] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:53:39.744494 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:39.745116 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:39.748137 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:39.748137 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:39.748646 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:39.749248 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:39.770726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] HTTP exception thrown: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Request method failure captured: Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: DELETE /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 HTTP/1.1 Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3rMcZSP9JUKenJrkwBoxOVJGH3juPapNOcsn6t91niRv_nTVY-ijKlWumABEAqVeIu_Y8XAzBGxnehumtXNvrsOVNBI9LXaAByOlvqX-XUccfbMeVqEqKvAz9zD8UAi7W3H1szQO5_PLJeUdohlE2_saLDATCAzuEIA3vLw5GSVZI8 Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:53:39.774815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/97408eeab80e45f9a27c405c23038f8c"}]}] Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 36a40c9d61174c38b007ba0a30fc95c3 Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:53:39.776327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '4e060778-7e35-44e9-99f4-f2fb64f07928'} Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:39.777059 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:53:39.779895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:53:39.781354 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Returning 404 to user: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:39.781354 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4c079555-2cde-4815-b4b0-5fbbeb5e258b tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 404 len: 111 microversion: 2.20 time: 0.056346 Aug 22 12:53:39.783122 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 357/716] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 22 12:53:39 2022] DELETE /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 22 12:53:39.788503 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:39.789245 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] [instance: 4e060778-7e35-44e9-99f4-f2fb64f07928] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:39.796934 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:39.797537 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:39.797839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:39.799747 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:39.799747 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:39.799747 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:39.816011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] HTTP exception thrown: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Request method failure captured: Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 HTTP/1.1 Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3rMcZSP9JUKenJrkwBoxOVJGH3juPapNOcsn6t91niRv_nTVY-ijKlWumABEAqVeIu_Y8XAzBGxnehumtXNvrsOVNBI9LXaAByOlvqX-XUccfbMeVqEqKvAz9zD8UAi7W3H1szQO5_PLJeUdohlE2_saLDATCAzuEIA3vLw5GSVZI8 Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:53:39.817928 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/97408eeab80e45f9a27c405c23038f8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/97408eeab80e45f9a27c405c23038f8c"}]}] Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 97408eeab80e45f9a27c405c23038f8c Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674642188 Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 36a40c9d61174c38b007ba0a30fc95c3 Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674642188-project Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:53:39.819429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '4e060778-7e35-44e9-99f4-f2fb64f07928'} Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:53:39.820825 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. Aug 22 12:53:39.822258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:53:39.824660 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] Returning 404 to user: Instance 4e060778-7e35-44e9-99f4-f2fb64f07928 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:53:39.825699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1b1eff48-8d33-476a-88f1-bdfdbc8e14d7 tempest-AttachVolumeShelveTestJSON-674642188 tempest-AttachVolumeShelveTestJSON-674642188-project] 10.222.0.15 "GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928" status: 404 len: 111 microversion: 2.20 time: 0.041642 Aug 22 12:53:39.826564 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 360/717] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 22 12:53:39 2022] GET /compute/v2.1/servers/4e060778-7e35-44e9-99f4-f2fb64f07928 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 12:53:40.700909 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0384c1be-3913-4c71-be54-34376b1bdf36 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:40.702126 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0384c1be-3913-4c71-be54-34376b1bdf36 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:40.713700 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0384c1be-3913-4c71-be54-34376b1bdf36 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:40.714974 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0384c1be-3913-4c71-be54-34376b1bdf36 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:40.715538 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0384c1be-3913-4c71-be54-34376b1bdf36 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:40.716690 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0384c1be-3913-4c71-be54-34376b1bdf36 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:40.717737 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0384c1be-3913-4c71-be54-34376b1bdf36 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:40.718862 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0384c1be-3913-4c71-be54-34376b1bdf36 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:40.881688 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0384c1be-3913-4c71-be54-34376b1bdf36 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:40.889934 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0384c1be-3913-4c71-be54-34376b1bdf36 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1367 microversion: 2.1 time: 0.192785 Aug 22 12:53:40.891578 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 358/718] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:40 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:41.912541 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ad0dbf1a-97be-4e29-b2ed-1817440004d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:41.913101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ad0dbf1a-97be-4e29-b2ed-1817440004d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:41.920564 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad0dbf1a-97be-4e29-b2ed-1817440004d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:41.921065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad0dbf1a-97be-4e29-b2ed-1817440004d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:41.921509 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad0dbf1a-97be-4e29-b2ed-1817440004d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:41.922356 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad0dbf1a-97be-4e29-b2ed-1817440004d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:41.922819 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad0dbf1a-97be-4e29-b2ed-1817440004d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:41.923251 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ad0dbf1a-97be-4e29-b2ed-1817440004d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:42.079978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ad0dbf1a-97be-4e29-b2ed-1817440004d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:42.082667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:42.089467 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ad0dbf1a-97be-4e29-b2ed-1817440004d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1367 microversion: 2.1 time: 0.180970 Aug 22 12:53:42.090282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 361/719] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:41 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:43.112551 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d2d07c3d-aca9-4793-acac-875f39113f68 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:43.113300 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d2d07c3d-aca9-4793-acac-875f39113f68 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:43.120679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2d07c3d-aca9-4793-acac-875f39113f68 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:43.121400 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2d07c3d-aca9-4793-acac-875f39113f68 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:43.121833 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2d07c3d-aca9-4793-acac-875f39113f68 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:43.122567 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2d07c3d-aca9-4793-acac-875f39113f68 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:43.123025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2d07c3d-aca9-4793-acac-875f39113f68 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:43.123456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d2d07c3d-aca9-4793-acac-875f39113f68 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:43.290570 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d2d07c3d-aca9-4793-acac-875f39113f68 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:53:43.299623 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d2d07c3d-aca9-4793-acac-875f39113f68 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1556 microversion: 2.1 time: 0.191243 Aug 22 12:53:43.310635 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 359/720] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:53:43 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1556 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:53:43.326827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2cf30d55-2273-481c-a816-f8e802b7a2a6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:53:43.327940 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2cf30d55-2273-481c-a816-f8e802b7a2a6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:53:43.336223 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf30d55-2273-481c-a816-f8e802b7a2a6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:43.336940 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf30d55-2273-481c-a816-f8e802b7a2a6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:43.337557 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf30d55-2273-481c-a816-f8e802b7a2a6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:43.338455 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf30d55-2273-481c-a816-f8e802b7a2a6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:43.339065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf30d55-2273-481c-a816-f8e802b7a2a6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:43.339668 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf30d55-2273-481c-a816-f8e802b7a2a6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:43.494318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2cf30d55-2273-481c-a816-f8e802b7a2a6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172444 Aug 22 12:53:43.495157 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 362/721] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 22 12:53:43 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:53:44.940114 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-ad1e50c0-f5a6-40c2-91a7-99cfbac8e8f7 req-174556c4-9ee0-4dcc-b576-eef8debcb745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746985f5-95e3-4ad2-a997-67653768dfd3", "tag": "21b63d76-4db0-4418-9307-fd5e2193ad9d"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:53:44.956952 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-ad1e50c0-f5a6-40c2-91a7-99cfbac8e8f7 req-174556c4-9ee0-4dcc-b576-eef8debcb745 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:53:44.957978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-ad1e50c0-f5a6-40c2-91a7-99cfbac8e8f7 req-174556c4-9ee0-4dcc-b576-eef8debcb745 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:53:44.962523 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-ad1e50c0-f5a6-40c2-91a7-99cfbac8e8f7 req-174556c4-9ee0-4dcc-b576-eef8debcb745 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:53:44.983325 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-ad1e50c0-f5a6-40c2-91a7-99cfbac8e8f7 req-174556c4-9ee0-4dcc-b576-eef8debcb745 service nova] Creating event network-changed:21b63d76-4db0-4418-9307-fd5e2193ad9d for instance 746985f5-95e3-4ad2-a997-67653768dfd3 on hv-cinder-85083 Aug 22 12:53:44.988917 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-ad1e50c0-f5a6-40c2-91a7-99cfbac8e8f7 req-174556c4-9ee0-4dcc-b576-eef8debcb745 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052388 Aug 22 12:53:44.990128 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 360/722] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:53:48.571429 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 12:53:48.572436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Mon Aug 22 12:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 12:54:21.246336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=15 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:21.247089 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=5 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:21.251000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2075ad26-7ac0-4716-a76c-1a9cfa5b0950 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:21.251497 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2075ad26-7ac0-4716-a76c-1a9cfa5b0950 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:21.259858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2075ad26-7ac0-4716-a76c-1a9cfa5b0950 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:21.259858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2075ad26-7ac0-4716-a76c-1a9cfa5b0950 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:21.259858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2075ad26-7ac0-4716-a76c-1a9cfa5b0950 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:21.259858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2075ad26-7ac0-4716-a76c-1a9cfa5b0950 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:21.260225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2075ad26-7ac0-4716-a76c-1a9cfa5b0950 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:21.260517 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2075ad26-7ac0-4716-a76c-1a9cfa5b0950 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:21.284039 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2075ad26-7ac0-4716-a76c-1a9cfa5b0950 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/ips" status: 200 len: 148 microversion: 2.1 time: 0.039076 Aug 22 12:54:21.284611 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 363/723] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 22 12:54:21 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:54:25.524496 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:25.525433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=50 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:25.529723 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-16a8f71e-888a-4f09-aad9-9845d7543017 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adcdcfe7-5eb5-4939-8aab-aace8368fbda"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:54:25.537226 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-16a8f71e-888a-4f09-aad9-9845d7543017 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:25.538001 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-16a8f71e-888a-4f09-aad9-9845d7543017 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:25.539016 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-16a8f71e-888a-4f09-aad9-9845d7543017 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:25.539452 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-16a8f71e-888a-4f09-aad9-9845d7543017 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:25.540208 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-16a8f71e-888a-4f09-aad9-9845d7543017 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:25.540605 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-16a8f71e-888a-4f09-aad9-9845d7543017 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:25.541269 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-16a8f71e-888a-4f09-aad9-9845d7543017 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:26.432063 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-16a8f71e-888a-4f09-aad9-9845d7543017 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908852 Aug 22 12:54:26.432800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 361/724] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:54:25 2022] POST /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-volume_attachments => generated 194 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:54:41.488914 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-75691c0a-da14-4507-b75b-aaa7a7de4916 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: .version_select at 0x7f7659d7dc10>, body: {"keypair": {"name": "tempest-keypair-1555673048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMYtwN1KEExQKQXu2Oz9TCCJt2Zhh9BZGdvdmP/c0dEyo+BE+ONBJ+THVNJBEH5szug9Hju17lXoNhCxzYQLHv6ZNUUtGCjgJ/JeSVKa0HQ3AwLajS5ssFVXnES0QjIWQ=="}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:54:41.507382 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-75691c0a-da14-4507-b75b-aaa7a7de4916 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:54:41.511370 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-75691c0a-da14-4507-b75b-aaa7a7de4916 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for user 74e80391b8814b44b13a6b38d36b15ee and project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:54:41.619248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-75691c0a-da14-4507-b75b-aaa7a7de4916 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136051 Aug 22 12:54:41.620530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 364/725] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 22 12:54:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:54:41.840220 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:41.845595 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-192839090", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "networks": [{"uuid": "d47ee9a6-d88d-481a-b70f-2bd9bed1ea50"}]}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:54:41.913018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.network.neutron [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] validate_networks() for [('d47ee9a6-d88d-481a-b70f-2bd9bed1ea50', None, None, None, None, None)] {{(pid=127810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:54:42.467428 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Flavor limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:54:42.467854 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Image limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:54:42.468341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Flavor pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:54:42.468811 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Image pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:54:42.469271 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:54:42.479120 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:42.479617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:42.480057 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:42.480797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:42.481430 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:42.481766 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:42.499305 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Getting quotas for project 2ad064334a6e49719a1162b53a6b7b0e. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:54:42.513224 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Getting quotas for user ee6b61e59be8455bb272c97b040684d4 and project 2ad064334a6e49719a1162b53a6b7b0e. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:54:42.515229 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Going to run 1 instances... {{(pid=127810) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:54:42.517617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:54:42.687063 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-cf632e71-8f17-486e-8989-5c9839305f23 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846914 Aug 22 12:54:42.689592 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 362/726] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:54:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:54:42.702522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e7314864-a493-4183-9ae6-73ae374fa2a5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:42.703359 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e7314864-a493-4183-9ae6-73ae374fa2a5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:42.840318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e7314864-a493-4183-9ae6-73ae374fa2a5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:42.850914 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e7314864-a493-4183-9ae6-73ae374fa2a5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1218 microversion: 2.1 time: 0.152698 Aug 22 12:54:42.852248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 365/727] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:42 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:43.873456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2b61940b-551b-464e-8026-241e665f7128 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:43.874090 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2b61940b-551b-464e-8026-241e665f7128 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:43.972165 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2b61940b-551b-464e-8026-241e665f7128 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:43.980562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2b61940b-551b-464e-8026-241e665f7128 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1218 microversion: 2.1 time: 0.111087 Aug 22 12:54:43.981497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 363/728] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:43 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:44.691965 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1991872703", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45d598ec-3137-4425-8c25-3a2a4913d98a"}], "security_groups": [{"name": "tempest-securitygroup--275591838"}], "key_name": "tempest-keypair-1555673048", "user_data": "}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:54:44.935532 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] validate_networks() for [('45d598ec-3137-4425-8c25-3a2a4913d98a', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:54:45.001474 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-77d49085-edfc-4315-b8fa-91951c905490 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:45.002749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-77d49085-edfc-4315-b8fa-91951c905490 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:45.010045 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-77d49085-edfc-4315-b8fa-91951c905490 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:45.013010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-77d49085-edfc-4315-b8fa-91951c905490 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:45.013010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-77d49085-edfc-4315-b8fa-91951c905490 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:45.013010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-77d49085-edfc-4315-b8fa-91951c905490 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:45.013010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-77d49085-edfc-4315-b8fa-91951c905490 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:45.019572 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-77d49085-edfc-4315-b8fa-91951c905490 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:45.147372 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-77d49085-edfc-4315-b8fa-91951c905490 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:45.161214 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-77d49085-edfc-4315-b8fa-91951c905490 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1270 microversion: 2.1 time: 0.163510 Aug 22 12:54:45.162230 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 364/729] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:44 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:45.334845 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:54:45.337244 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:54:45.337244 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:54:45.337244 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:54:45.337244 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:54:45.346939 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:45.347500 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:45.348004 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:45.349038 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:45.349553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:45.350215 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:45.367700 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:54:45.371871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for user 74e80391b8814b44b13a6b38d36b15ee and project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:54:45.383549 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:54:45.385963 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:54:45.540422 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a59f0a8b-d6f3-4654-8e75-a0e76a56377a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.851145 Aug 22 12:54:45.541893 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 366/730] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:54:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:54:45.552824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e1952ae3-afc1-4d4e-a280-80ae3b6e4291 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:45.553748 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e1952ae3-afc1-4d4e-a280-80ae3b6e4291 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:45.656165 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e1952ae3-afc1-4d4e-a280-80ae3b6e4291 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:45.669263 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e1952ae3-afc1-4d4e-a280-80ae3b6e4291 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1242 microversion: 2.1 time: 0.120098 Aug 22 12:54:45.682659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 365/731] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:45 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1242 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:46.210072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-82c1c7f0-ad1a-4c67-855d-569499a16dfe tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:46.212731 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-82c1c7f0-ad1a-4c67-855d-569499a16dfe tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:46.225135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-82c1c7f0-ad1a-4c67-855d-569499a16dfe tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:46.225618 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-82c1c7f0-ad1a-4c67-855d-569499a16dfe tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:46.226347 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-82c1c7f0-ad1a-4c67-855d-569499a16dfe tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:46.227576 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-82c1c7f0-ad1a-4c67-855d-569499a16dfe tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:46.228102 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-82c1c7f0-ad1a-4c67-855d-569499a16dfe tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:46.228942 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-82c1c7f0-ad1a-4c67-855d-569499a16dfe tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:46.460979 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-82c1c7f0-ad1a-4c67-855d-569499a16dfe tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:46.466472 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-82c1c7f0-ad1a-4c67-855d-569499a16dfe tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1276 microversion: 2.1 time: 0.267184 Aug 22 12:54:46.467204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 367/732] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:46 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:46.692363 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-57f05712-db1c-482e-851b-0a6a950c0294 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:46.692950 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-57f05712-db1c-482e-851b-0a6a950c0294 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:46.753759 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-57f05712-db1c-482e-851b-0a6a950c0294 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:46.765341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-57f05712-db1c-482e-851b-0a6a950c0294 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1242 microversion: 2.1 time: 0.077438 Aug 22 12:54:46.766264 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 366/733] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:46 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:47.490669 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-fdc0adce-0d61-41b0-a345-c1934e181d0e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:47.493603 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-fdc0adce-0d61-41b0-a345-c1934e181d0e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:47.523805 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fdc0adce-0d61-41b0-a345-c1934e181d0e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:47.524312 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fdc0adce-0d61-41b0-a345-c1934e181d0e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:47.526851 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fdc0adce-0d61-41b0-a345-c1934e181d0e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:47.536453 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fdc0adce-0d61-41b0-a345-c1934e181d0e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:47.556943 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fdc0adce-0d61-41b0-a345-c1934e181d0e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:47.558880 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fdc0adce-0d61-41b0-a345-c1934e181d0e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:47.788252 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-875bd135-1b83-43f6-8501-d90bd5716e45 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:47.789416 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-875bd135-1b83-43f6-8501-d90bd5716e45 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:47.805267 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-875bd135-1b83-43f6-8501-d90bd5716e45 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:47.805984 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-875bd135-1b83-43f6-8501-d90bd5716e45 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:47.806610 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-fdc0adce-0d61-41b0-a345-c1934e181d0e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:47.806783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-875bd135-1b83-43f6-8501-d90bd5716e45 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:47.807799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-875bd135-1b83-43f6-8501-d90bd5716e45 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:47.808432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-875bd135-1b83-43f6-8501-d90bd5716e45 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:47.809007 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-875bd135-1b83-43f6-8501-d90bd5716e45 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:47.824537 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-fdc0adce-0d61-41b0-a345-c1934e181d0e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1318 microversion: 2.1 time: 0.339208 Aug 22 12:54:47.832773 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 368/734] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:47 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:47.972330 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-875bd135-1b83-43f6-8501-d90bd5716e45 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:47.983076 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-875bd135-1b83-43f6-8501-d90bd5716e45 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1294 microversion: 2.1 time: 0.200783 Aug 22 12:54:48.002443 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 367/735] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:47 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1294 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:54:48.325759 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-7e8b314e-ff10-4fa8-8f64-f7b67657bbd0 req-411807f0-4815-4476-9e79-c11e821079fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "767b4644-c6d4-43ec-8dd7-24417f247866", "tag": "8ed9475f-2ecd-4b57-a670-dc71e33b3a2f"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:54:48.351357 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-7e8b314e-ff10-4fa8-8f64-f7b67657bbd0 req-411807f0-4815-4476-9e79-c11e821079fc service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:48.355312 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-7e8b314e-ff10-4fa8-8f64-f7b67657bbd0 req-411807f0-4815-4476-9e79-c11e821079fc service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:48.355312 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-7e8b314e-ff10-4fa8-8f64-f7b67657bbd0 req-411807f0-4815-4476-9e79-c11e821079fc service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:48.370666 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-7e8b314e-ff10-4fa8-8f64-f7b67657bbd0 req-411807f0-4815-4476-9e79-c11e821079fc service nova] Creating event network-changed:8ed9475f-2ecd-4b57-a670-dc71e33b3a2f for instance 767b4644-c6d4-43ec-8dd7-24417f247866 on hv-cinder-85083 Aug 22 12:54:48.380902 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-7e8b314e-ff10-4fa8-8f64-f7b67657bbd0 req-411807f0-4815-4476-9e79-c11e821079fc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058504 Aug 22 12:54:48.382349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 369/736] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:54:48.849891 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-bcce58c0-68b5-4810-82e9-807c3eb956cc tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:48.849891 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-bcce58c0-68b5-4810-82e9-807c3eb956cc tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:48.867045 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcce58c0-68b5-4810-82e9-807c3eb956cc tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:48.868513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcce58c0-68b5-4810-82e9-807c3eb956cc tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:48.869450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcce58c0-68b5-4810-82e9-807c3eb956cc tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:48.870556 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcce58c0-68b5-4810-82e9-807c3eb956cc tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:48.871239 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcce58c0-68b5-4810-82e9-807c3eb956cc tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:48.877007 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcce58c0-68b5-4810-82e9-807c3eb956cc tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:49.008343 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3af798af-bba5-4800-9e62-5c61ceb9cbbe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:49.011652 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-3af798af-bba5-4800-9e62-5c61ceb9cbbe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:49.030069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3af798af-bba5-4800-9e62-5c61ceb9cbbe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:49.030802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3af798af-bba5-4800-9e62-5c61ceb9cbbe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:49.034599 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3af798af-bba5-4800-9e62-5c61ceb9cbbe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:49.034599 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3af798af-bba5-4800-9e62-5c61ceb9cbbe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:49.034599 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3af798af-bba5-4800-9e62-5c61ceb9cbbe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:49.034599 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3af798af-bba5-4800-9e62-5c61ceb9cbbe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:49.142299 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-bcce58c0-68b5-4810-82e9-807c3eb956cc tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:49.154608 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-bcce58c0-68b5-4810-82e9-807c3eb956cc tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1318 microversion: 2.1 time: 0.312029 Aug 22 12:54:49.155195 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 368/737] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:48 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:49.180654 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3af798af-bba5-4800-9e62-5c61ceb9cbbe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:49.199034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-3af798af-bba5-4800-9e62-5c61ceb9cbbe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1300 microversion: 2.1 time: 0.197850 Aug 22 12:54:49.213973 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 370/738] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:48 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1300 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:50.178375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c476147c-45ee-41f0-b78f-ff55c7555e79 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:50.179024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c476147c-45ee-41f0-b78f-ff55c7555e79 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:50.186784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c476147c-45ee-41f0-b78f-ff55c7555e79 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:50.187275 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c476147c-45ee-41f0-b78f-ff55c7555e79 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:50.187709 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c476147c-45ee-41f0-b78f-ff55c7555e79 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:50.188403 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c476147c-45ee-41f0-b78f-ff55c7555e79 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:50.188854 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c476147c-45ee-41f0-b78f-ff55c7555e79 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:50.189281 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c476147c-45ee-41f0-b78f-ff55c7555e79 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:50.224363 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-debaea03-a8fb-4596-a46d-9cccb82cd526 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:50.225167 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-debaea03-a8fb-4596-a46d-9cccb82cd526 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:50.232444 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debaea03-a8fb-4596-a46d-9cccb82cd526 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:50.233076 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debaea03-a8fb-4596-a46d-9cccb82cd526 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:50.233517 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debaea03-a8fb-4596-a46d-9cccb82cd526 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:50.234250 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debaea03-a8fb-4596-a46d-9cccb82cd526 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:50.234750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debaea03-a8fb-4596-a46d-9cccb82cd526 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:50.235180 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-debaea03-a8fb-4596-a46d-9cccb82cd526 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:50.536272 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c476147c-45ee-41f0-b78f-ff55c7555e79 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:50.552539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c476147c-45ee-41f0-b78f-ff55c7555e79 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1318 microversion: 2.1 time: 0.377693 Aug 22 12:54:50.554216 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 369/739] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:50 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:50.571068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-debaea03-a8fb-4596-a46d-9cccb82cd526 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:50.579305 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-debaea03-a8fb-4596-a46d-9cccb82cd526 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1367 microversion: 2.1 time: 0.359711 Aug 22 12:54:50.580433 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 371/740] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:50 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:54:51.236145 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-bc501830-9414-4bfb-8619-9896e8cf1d5d req-f905b6ec-0e07-4f89-bd9b-c309519fbd30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c9cb84-5a6e-46f5-a67a-ba8cc838829a", "tag": "6be1384d-f5c4-4789-8d5e-b39dec57ee4a"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:54:51.256918 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-bc501830-9414-4bfb-8619-9896e8cf1d5d req-f905b6ec-0e07-4f89-bd9b-c309519fbd30 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:51.257997 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-bc501830-9414-4bfb-8619-9896e8cf1d5d req-f905b6ec-0e07-4f89-bd9b-c309519fbd30 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:51.263295 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-bc501830-9414-4bfb-8619-9896e8cf1d5d req-f905b6ec-0e07-4f89-bd9b-c309519fbd30 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:51.285670 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-bc501830-9414-4bfb-8619-9896e8cf1d5d req-f905b6ec-0e07-4f89-bd9b-c309519fbd30 service nova] Creating event network-changed:6be1384d-f5c4-4789-8d5e-b39dec57ee4a for instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a on hv-cinder-85083 Aug 22 12:54:51.298258 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-bc501830-9414-4bfb-8619-9896e8cf1d5d req-f905b6ec-0e07-4f89-bd9b-c309519fbd30 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065523 Aug 22 12:54:51.302906 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 370/741] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:54:51.579301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-33dbd34d-a125-465c-8197-a2d75f1428ec tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:51.579837 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-33dbd34d-a125-465c-8197-a2d75f1428ec tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:51.586687 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33dbd34d-a125-465c-8197-a2d75f1428ec tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:51.587453 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33dbd34d-a125-465c-8197-a2d75f1428ec tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:51.588063 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33dbd34d-a125-465c-8197-a2d75f1428ec tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:51.588969 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33dbd34d-a125-465c-8197-a2d75f1428ec tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:51.589422 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33dbd34d-a125-465c-8197-a2d75f1428ec tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:51.590024 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-33dbd34d-a125-465c-8197-a2d75f1428ec tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:51.604992 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-37e9e01c-8ddb-4962-afd3-2356f3acc447 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:51.605793 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-37e9e01c-8ddb-4962-afd3-2356f3acc447 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:51.621116 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37e9e01c-8ddb-4962-afd3-2356f3acc447 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:51.621714 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37e9e01c-8ddb-4962-afd3-2356f3acc447 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:51.623694 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37e9e01c-8ddb-4962-afd3-2356f3acc447 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:51.624489 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37e9e01c-8ddb-4962-afd3-2356f3acc447 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:51.626715 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37e9e01c-8ddb-4962-afd3-2356f3acc447 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:51.627239 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37e9e01c-8ddb-4962-afd3-2356f3acc447 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:51.910822 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-33dbd34d-a125-465c-8197-a2d75f1428ec tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:51.923054 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-33dbd34d-a125-465c-8197-a2d75f1428ec tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1318 microversion: 2.1 time: 0.351045 Aug 22 12:54:51.924687 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 372/742] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:51 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:51.942570 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-37e9e01c-8ddb-4962-afd3-2356f3acc447 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:51.950935 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-37e9e01c-8ddb-4962-afd3-2356f3acc447 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1367 microversion: 2.1 time: 0.352118 Aug 22 12:54:51.959902 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 371/743] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:51 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:52.945745 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6bbeb67c-80ba-4bfa-a92a-4d6c71e172b2 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:52.946499 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6bbeb67c-80ba-4bfa-a92a-4d6c71e172b2 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:52.948960 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:52.953847 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6bbeb67c-80ba-4bfa-a92a-4d6c71e172b2 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:52.954451 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6bbeb67c-80ba-4bfa-a92a-4d6c71e172b2 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:52.954978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6bbeb67c-80ba-4bfa-a92a-4d6c71e172b2 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:52.955656 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6bbeb67c-80ba-4bfa-a92a-4d6c71e172b2 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:52.956122 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6bbeb67c-80ba-4bfa-a92a-4d6c71e172b2 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:52.956550 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6bbeb67c-80ba-4bfa-a92a-4d6c71e172b2 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:52.958061 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-752956e2-f6b4-4208-a376-4a65df953da2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Action: 'create', calling method: .version_select at 0x7f7659ccab80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1880130090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEG43Fc9aFgGoEMn7JFR9CKycBDTywdg9vNpbm0rLiipu/VLVWtjBXnC+816zMVuOwv3ZIliN6r3G3j/if9y/DiqyQquXjwa5+rjFKmltNicF48IpcstEIcnzcEWslDxBg=="}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:54:52.973602 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-752956e2-f6b4-4208-a376-4a65df953da2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Getting quotas for project 66ab7e2f4bbd43f4a795a5f1068a32f9. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:54:52.977419 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-752956e2-f6b4-4208-a376-4a65df953da2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Getting quotas for user 35306cf75bde4fdcbb1374fa9ab82aa7 and project 66ab7e2f4bbd43f4a795a5f1068a32f9. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:54:53.063674 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-752956e2-f6b4-4208-a376-4a65df953da2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.268037 Aug 22 12:54:53.065003 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 373/744] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 22 12:54:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:54:53.070154 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-86f1b4c1-7baf-45bb-87f2-7d5a6d2cc08c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:53.070771 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-86f1b4c1-7baf-45bb-87f2-7d5a6d2cc08c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:53.081152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-86f1b4c1-7baf-45bb-87f2-7d5a6d2cc08c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:53.082040 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-86f1b4c1-7baf-45bb-87f2-7d5a6d2cc08c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:53.082670 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-86f1b4c1-7baf-45bb-87f2-7d5a6d2cc08c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:53.083650 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-86f1b4c1-7baf-45bb-87f2-7d5a6d2cc08c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:53.084306 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-86f1b4c1-7baf-45bb-87f2-7d5a6d2cc08c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:53.084883 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-86f1b4c1-7baf-45bb-87f2-7d5a6d2cc08c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:53.117587 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6bbeb67c-80ba-4bfa-a92a-4d6c71e172b2 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:53.125271 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6bbeb67c-80ba-4bfa-a92a-4d6c71e172b2 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1318 microversion: 2.1 time: 0.184935 Aug 22 12:54:53.126014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 372/745] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:52 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:54:53.265452 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-86f1b4c1-7baf-45bb-87f2-7d5a6d2cc08c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:53.271356 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-86f1b4c1-7baf-45bb-87f2-7d5a6d2cc08c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1367 microversion: 2.1 time: 0.205052 Aug 22 12:54:53.271935 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 374/746] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:53 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:54.145514 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f97f4c23-f736-4398-9f14-33738995eb48 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:54.146347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f97f4c23-f736-4398-9f14-33738995eb48 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:54.153032 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f97f4c23-f736-4398-9f14-33738995eb48 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:54.154642 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f97f4c23-f736-4398-9f14-33738995eb48 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:54.154642 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f97f4c23-f736-4398-9f14-33738995eb48 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:54.154846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f97f4c23-f736-4398-9f14-33738995eb48 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:54.155256 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f97f4c23-f736-4398-9f14-33738995eb48 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:54.155676 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f97f4c23-f736-4398-9f14-33738995eb48 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:54.294936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-124a6f2c-d14c-4410-ba2e-3a9401a6d5a7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:54.296596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-124a6f2c-d14c-4410-ba2e-3a9401a6d5a7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:54.304530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f97f4c23-f736-4398-9f14-33738995eb48 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:54.305143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-124a6f2c-d14c-4410-ba2e-3a9401a6d5a7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:54.305984 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-124a6f2c-d14c-4410-ba2e-3a9401a6d5a7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:54.306728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-124a6f2c-d14c-4410-ba2e-3a9401a6d5a7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:54.307668 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-124a6f2c-d14c-4410-ba2e-3a9401a6d5a7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:54.308798 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-124a6f2c-d14c-4410-ba2e-3a9401a6d5a7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:54.309435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-124a6f2c-d14c-4410-ba2e-3a9401a6d5a7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:54.327361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f97f4c23-f736-4398-9f14-33738995eb48 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1318 microversion: 2.1 time: 0.185698 Aug 22 12:54:54.334623 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 373/747] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:54 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:54.512008 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-124a6f2c-d14c-4410-ba2e-3a9401a6d5a7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:54.516396 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-124a6f2c-d14c-4410-ba2e-3a9401a6d5a7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1367 microversion: 2.1 time: 0.228386 Aug 22 12:54:54.516968 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 375/748] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:54 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:55.356497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b5c01eb2-f303-4c50-897b-ec0ecacaa538 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:55.357311 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b5c01eb2-f303-4c50-897b-ec0ecacaa538 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:55.366209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5c01eb2-f303-4c50-897b-ec0ecacaa538 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:55.366209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5c01eb2-f303-4c50-897b-ec0ecacaa538 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:55.366209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5c01eb2-f303-4c50-897b-ec0ecacaa538 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:55.366209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5c01eb2-f303-4c50-897b-ec0ecacaa538 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:55.367218 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5c01eb2-f303-4c50-897b-ec0ecacaa538 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:55.367651 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5c01eb2-f303-4c50-897b-ec0ecacaa538 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:55.507086 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b5c01eb2-f303-4c50-897b-ec0ecacaa538 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:55.514662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b5c01eb2-f303-4c50-897b-ec0ecacaa538 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1318 microversion: 2.1 time: 0.162628 Aug 22 12:54:55.515228 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 374/749] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:55 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:55.536849 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ee088bf9-b6dd-4058-8387-23002ffbe39e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:55.537476 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ee088bf9-b6dd-4058-8387-23002ffbe39e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:55.540414 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:55.545893 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee088bf9-b6dd-4058-8387-23002ffbe39e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:55.546457 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee088bf9-b6dd-4058-8387-23002ffbe39e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:55.546908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee088bf9-b6dd-4058-8387-23002ffbe39e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:55.547841 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee088bf9-b6dd-4058-8387-23002ffbe39e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:55.548310 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee088bf9-b6dd-4058-8387-23002ffbe39e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:55.548743 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee088bf9-b6dd-4058-8387-23002ffbe39e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:55.736402 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ee088bf9-b6dd-4058-8387-23002ffbe39e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:55.736861 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ee088bf9-b6dd-4058-8387-23002ffbe39e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1367 microversion: 2.1 time: 0.203366 Aug 22 12:54:55.737035 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 376/750] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:55 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:56.298637 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-eebe3dd9-4b7a-4a0b-8064-78f6a48fa58d req-094f503d-672b-49ee-ad31-16319a854fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "767b4644-c6d4-43ec-8dd7-24417f247866", "name": "network-vif-plugged", "status": "completed", "tag": "8ed9475f-2ecd-4b57-a670-dc71e33b3a2f"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:54:56.312320 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-eebe3dd9-4b7a-4a0b-8064-78f6a48fa58d req-094f503d-672b-49ee-ad31-16319a854fbc service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:56.312812 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-eebe3dd9-4b7a-4a0b-8064-78f6a48fa58d req-094f503d-672b-49ee-ad31-16319a854fbc service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:56.313249 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-eebe3dd9-4b7a-4a0b-8064-78f6a48fa58d req-094f503d-672b-49ee-ad31-16319a854fbc service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:56.333558 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-eebe3dd9-4b7a-4a0b-8064-78f6a48fa58d req-094f503d-672b-49ee-ad31-16319a854fbc service nova] Creating event network-vif-plugged:8ed9475f-2ecd-4b57-a670-dc71e33b3a2f for instance 767b4644-c6d4-43ec-8dd7-24417f247866 on hv-cinder-85083 Aug 22 12:54:56.333715 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-eebe3dd9-4b7a-4a0b-8064-78f6a48fa58d req-094f503d-672b-49ee-ad31-16319a854fbc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046297 Aug 22 12:54:56.334362 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 375/751] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:54:56.535722 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8d32e433-bba8-4451-8673-7130544b1cad tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:56.536892 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8d32e433-bba8-4451-8673-7130544b1cad tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:56.544631 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8d32e433-bba8-4451-8673-7130544b1cad tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:56.545193 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8d32e433-bba8-4451-8673-7130544b1cad tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:56.545660 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8d32e433-bba8-4451-8673-7130544b1cad tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:56.546416 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8d32e433-bba8-4451-8673-7130544b1cad tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:56.546870 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8d32e433-bba8-4451-8673-7130544b1cad tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:56.547528 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8d32e433-bba8-4451-8673-7130544b1cad tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:56.700295 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8d32e433-bba8-4451-8673-7130544b1cad tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:56.708607 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8d32e433-bba8-4451-8673-7130544b1cad tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1318 microversion: 2.1 time: 0.177113 Aug 22 12:54:56.709177 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 377/752] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:56 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:56.762679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-5d893d08-9f93-4e68-9630-80f12dd39d6f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:56.770427 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-5d893d08-9f93-4e68-9630-80f12dd39d6f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:56.770427 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=12 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:56.771134 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d893d08-9f93-4e68-9630-80f12dd39d6f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:56.771666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d893d08-9f93-4e68-9630-80f12dd39d6f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:56.772450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d893d08-9f93-4e68-9630-80f12dd39d6f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:56.772844 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d893d08-9f93-4e68-9630-80f12dd39d6f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:56.773310 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d893d08-9f93-4e68-9630-80f12dd39d6f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:56.773796 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5d893d08-9f93-4e68-9630-80f12dd39d6f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:56.905437 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-5d893d08-9f93-4e68-9630-80f12dd39d6f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:56.913784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-5d893d08-9f93-4e68-9630-80f12dd39d6f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1367 microversion: 2.1 time: 0.156034 Aug 22 12:54:56.914384 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 376/753] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:56 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:54:57.729822 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6bad8fdd-65d4-4e6e-b11e-ee10e1abf60e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:57.730544 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6bad8fdd-65d4-4e6e-b11e-ee10e1abf60e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:57.736867 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6bad8fdd-65d4-4e6e-b11e-ee10e1abf60e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:57.737351 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6bad8fdd-65d4-4e6e-b11e-ee10e1abf60e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:57.737875 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6bad8fdd-65d4-4e6e-b11e-ee10e1abf60e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:57.738590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6bad8fdd-65d4-4e6e-b11e-ee10e1abf60e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:57.739051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6bad8fdd-65d4-4e6e-b11e-ee10e1abf60e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:57.739487 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6bad8fdd-65d4-4e6e-b11e-ee10e1abf60e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:57.875788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6bad8fdd-65d4-4e6e-b11e-ee10e1abf60e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:57.883240 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6bad8fdd-65d4-4e6e-b11e-ee10e1abf60e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1318 microversion: 2.1 time: 0.158163 Aug 22 12:54:57.883795 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 378/754] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:57 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:57.934513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-cb767536-0306-48e6-bd53-0766bd2a69b6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:57.935413 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-cb767536-0306-48e6-bd53-0766bd2a69b6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:57.942147 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb767536-0306-48e6-bd53-0766bd2a69b6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:57.942662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb767536-0306-48e6-bd53-0766bd2a69b6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:57.943097 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb767536-0306-48e6-bd53-0766bd2a69b6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:57.943794 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb767536-0306-48e6-bd53-0766bd2a69b6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:57.944248 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb767536-0306-48e6-bd53-0766bd2a69b6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:57.945423 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb767536-0306-48e6-bd53-0766bd2a69b6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:58.088033 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-cb767536-0306-48e6-bd53-0766bd2a69b6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:58.096521 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-cb767536-0306-48e6-bd53-0766bd2a69b6 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1367 microversion: 2.1 time: 0.165923 Aug 22 12:54:58.097071 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 377/755] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:57 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:54:58.351470 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-b065da7b-3ed2-46f9-a7d1-02ed62655019 req-d57ac9d4-fed4-489a-bbd8-661af3868b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c9cb84-5a6e-46f5-a67a-ba8cc838829a", "name": "network-vif-plugged", "status": "completed", "tag": "6be1384d-f5c4-4789-8d5e-b39dec57ee4a"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:54:58.361956 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-b065da7b-3ed2-46f9-a7d1-02ed62655019 req-d57ac9d4-fed4-489a-bbd8-661af3868b25 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:58.362715 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-b065da7b-3ed2-46f9-a7d1-02ed62655019 req-d57ac9d4-fed4-489a-bbd8-661af3868b25 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:58.363150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-b065da7b-3ed2-46f9-a7d1-02ed62655019 req-d57ac9d4-fed4-489a-bbd8-661af3868b25 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:58.374581 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-b065da7b-3ed2-46f9-a7d1-02ed62655019 req-d57ac9d4-fed4-489a-bbd8-661af3868b25 service nova] Creating event network-vif-plugged:6be1384d-f5c4-4789-8d5e-b39dec57ee4a for instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a on hv-cinder-85083 Aug 22 12:54:58.379257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-b065da7b-3ed2-46f9-a7d1-02ed62655019 req-d57ac9d4-fed4-489a-bbd8-661af3868b25 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033056 Aug 22 12:54:58.379826 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 379/756] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:54:58.903885 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8a54b508-ca55-49f3-a730-6f9c4c9d16eb tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:58.904572 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8a54b508-ca55-49f3-a730-6f9c4c9d16eb tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:58.910683 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a54b508-ca55-49f3-a730-6f9c4c9d16eb tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:58.911173 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a54b508-ca55-49f3-a730-6f9c4c9d16eb tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:58.911608 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a54b508-ca55-49f3-a730-6f9c4c9d16eb tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:58.912310 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a54b508-ca55-49f3-a730-6f9c4c9d16eb tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:58.912766 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a54b508-ca55-49f3-a730-6f9c4c9d16eb tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:58.913191 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8a54b508-ca55-49f3-a730-6f9c4c9d16eb tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:59.060376 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8a54b508-ca55-49f3-a730-6f9c4c9d16eb tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:59.068806 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8a54b508-ca55-49f3-a730-6f9c4c9d16eb tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1507 microversion: 2.1 time: 0.168962 Aug 22 12:54:59.070139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 378/757] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:58 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:54:59.129557 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7d7b5a8a-11fb-435b-8063-5d9c069e66fe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:54:59.130291 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7d7b5a8a-11fb-435b-8063-5d9c069e66fe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:54:59.136526 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a8a-11fb-435b-8063-5d9c069e66fe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:59.137025 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a8a-11fb-435b-8063-5d9c069e66fe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:59.137695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a8a-11fb-435b-8063-5d9c069e66fe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:59.138739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a8a-11fb-435b-8063-5d9c069e66fe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:54:59.139402 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a8a-11fb-435b-8063-5d9c069e66fe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:54:59.139831 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a8a-11fb-435b-8063-5d9c069e66fe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:54:59.292319 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7d7b5a8a-11fb-435b-8063-5d9c069e66fe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:54:59.300120 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7d7b5a8a-11fb-435b-8063-5d9c069e66fe tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1367 microversion: 2.1 time: 0.175335 Aug 22 12:54:59.300698 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 380/758] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:54:59 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:00.321864 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-838cec48-1229-423e-8194-b75420279cf0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:00.322466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-838cec48-1229-423e-8194-b75420279cf0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:00.328725 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-838cec48-1229-423e-8194-b75420279cf0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:00.329237 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-838cec48-1229-423e-8194-b75420279cf0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:00.333379 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-838cec48-1229-423e-8194-b75420279cf0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:00.333379 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-838cec48-1229-423e-8194-b75420279cf0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:00.333379 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-838cec48-1229-423e-8194-b75420279cf0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:00.333379 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-838cec48-1229-423e-8194-b75420279cf0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:00.462352 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-838cec48-1229-423e-8194-b75420279cf0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:00.471033 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-838cec48-1229-423e-8194-b75420279cf0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1367 microversion: 2.1 time: 0.153847 Aug 22 12:55:00.471875 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 379/759] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:00 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:01.493759 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6e60441a-a680-4e3a-aa8b-16be49429219 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:01.494449 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6e60441a-a680-4e3a-aa8b-16be49429219 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:01.501175 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e60441a-a680-4e3a-aa8b-16be49429219 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:01.502043 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e60441a-a680-4e3a-aa8b-16be49429219 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:01.502410 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e60441a-a680-4e3a-aa8b-16be49429219 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:01.502840 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e60441a-a680-4e3a-aa8b-16be49429219 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:01.503534 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e60441a-a680-4e3a-aa8b-16be49429219 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:01.503733 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6e60441a-a680-4e3a-aa8b-16be49429219 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:01.641381 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6e60441a-a680-4e3a-aa8b-16be49429219 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:01.649891 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6e60441a-a680-4e3a-aa8b-16be49429219 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1557 microversion: 2.1 time: 0.160563 Aug 22 12:55:01.653055 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 381/760] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:01 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:01.671588 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b4f62526-2272-4c3b-9705-b745ce615ad5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:01.672087 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b4f62526-2272-4c3b-9705-b745ce615ad5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:01.678428 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b4f62526-2272-4c3b-9705-b745ce615ad5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:01.679436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b4f62526-2272-4c3b-9705-b745ce615ad5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:01.679872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b4f62526-2272-4c3b-9705-b745ce615ad5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:01.680566 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b4f62526-2272-4c3b-9705-b745ce615ad5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:01.681021 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b4f62526-2272-4c3b-9705-b745ce615ad5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:01.681444 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b4f62526-2272-4c3b-9705-b745ce615ad5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:01.763116 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b4f62526-2272-4c3b-9705-b745ce615ad5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095267 Aug 22 12:55:01.763703 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 380/761] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 22 12:55:01 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:55:02.740728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-464de0c1-4bb1-4bda-aced-aceecff1146a req-c09717da-fcd7-4f44-97a6-0be02f4739e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c9cb84-5a6e-46f5-a67a-ba8cc838829a", "tag": "6be1384d-f5c4-4789-8d5e-b39dec57ee4a"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:55:02.751873 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-464de0c1-4bb1-4bda-aced-aceecff1146a req-c09717da-fcd7-4f44-97a6-0be02f4739e2 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:02.751873 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-464de0c1-4bb1-4bda-aced-aceecff1146a req-c09717da-fcd7-4f44-97a6-0be02f4739e2 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:02.752414 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-464de0c1-4bb1-4bda-aced-aceecff1146a req-c09717da-fcd7-4f44-97a6-0be02f4739e2 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:02.764262 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-464de0c1-4bb1-4bda-aced-aceecff1146a req-c09717da-fcd7-4f44-97a6-0be02f4739e2 service nova] Creating event network-changed:6be1384d-f5c4-4789-8d5e-b39dec57ee4a for instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a on hv-cinder-85083 Aug 22 12:55:02.769018 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-464de0c1-4bb1-4bda-aced-aceecff1146a req-c09717da-fcd7-4f44-97a6-0be02f4739e2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031993 Aug 22 12:55:02.769690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 382/762] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:55:18.807363 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:18.808139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=82 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:18.812043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1078973982", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1880130090", "security_groups": [{"name": "tempest-secgroup-smoke-2114417346"}], "block_device_mapping_v2": [{"uuid": "b18c0366-c6fe-4974-a870-4084115eb376", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f69688de-f377-4c85-a58c-b5ac46ea4c35"}]}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:55:18.924677 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.network.neutron [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] validate_networks() for [('f69688de-f377-4c85-a58c-b5ac46ea4c35', None, None, None, None, None)] {{(pid=127810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:55:19.295349 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Flavor limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:55:19.295780 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Image limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:55:19.296255 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Flavor pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:55:19.296673 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Image pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:55:19.297088 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:55:19.307401 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:19.307884 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:19.308323 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:19.309041 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:19.309495 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:19.309918 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:19.325908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Getting quotas for project 66ab7e2f4bbd43f4a795a5f1068a32f9. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:55:19.330001 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Getting quotas for user 35306cf75bde4fdcbb1374fa9ab82aa7 and project 66ab7e2f4bbd43f4a795a5f1068a32f9. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:55:19.386538 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Going to run 1 instances... {{(pid=127810) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:55:19.388633 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b18c0366-c6fe-4974-a870-4084115eb376',volume_size=None,volume_type=None)] {{(pid=127810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:55:19.842990 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-277bb483-c000-41c4-8577-b4b70bc31960 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.035722 Aug 22 12:55:19.843969 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 381/763] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:55:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:55:19.853169 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=16 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:19.855851 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=5 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:19.855851 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=84 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:19.860234 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6c7789ba-e047-4a89-9251-ab642f01ba20 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:19.861204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6c7789ba-e047-4a89-9251-ab642f01ba20 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:19.918716 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6c7789ba-e047-4a89-9251-ab642f01ba20 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:19.925387 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6c7789ba-e047-4a89-9251-ab642f01ba20 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1095 microversion: 2.1 time: 0.073124 Aug 22 12:55:19.925956 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 383/764] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:19 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:20.946780 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1c97547b-78ce-414c-a017-c75862abfecf tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:20.947336 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1c97547b-78ce-414c-a017-c75862abfecf tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:21.000333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1c97547b-78ce-414c-a017-c75862abfecf tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:21.007332 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1c97547b-78ce-414c-a017-c75862abfecf tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1095 microversion: 2.1 time: 0.065521 Aug 22 12:55:21.014433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 382/765] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:20 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:21.175521 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ed2136b8-5c53-4cfb-b011-4ba084839828 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69db5ed1-9fb2-4946-99ec-3ac3793cb3fe", "device": "/dev/sdb"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:55:21.178441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ed2136b8-5c53-4cfb-b011-4ba084839828 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:21.187260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed2136b8-5c53-4cfb-b011-4ba084839828 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:21.188676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed2136b8-5c53-4cfb-b011-4ba084839828 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:21.188676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed2136b8-5c53-4cfb-b011-4ba084839828 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:21.188960 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed2136b8-5c53-4cfb-b011-4ba084839828 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:21.189279 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed2136b8-5c53-4cfb-b011-4ba084839828 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:21.189696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ed2136b8-5c53-4cfb-b011-4ba084839828 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:22.028900 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-80619e3a-f918-467c-a093-becfca679958 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:22.029513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-80619e3a-f918-467c-a093-becfca679958 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:22.035897 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80619e3a-f918-467c-a093-becfca679958 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:22.036381 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80619e3a-f918-467c-a093-becfca679958 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:22.036817 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80619e3a-f918-467c-a093-becfca679958 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:22.037515 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80619e3a-f918-467c-a093-becfca679958 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:22.037972 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80619e3a-f918-467c-a093-becfca679958 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:22.038439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80619e3a-f918-467c-a093-becfca679958 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:22.099704 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-80619e3a-f918-467c-a093-becfca679958 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:22.108108 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-80619e3a-f918-467c-a093-becfca679958 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1193 microversion: 2.1 time: 0.083095 Aug 22 12:55:22.108672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 383/766] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:22 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:55:22.161653 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ed2136b8-5c53-4cfb-b011-4ba084839828 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "POST /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.989873 Aug 22 12:55:22.162340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 384/767] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:55:21 2022] POST /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866/os-volume_attachments => generated 194 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:55:23.129068 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-fc9535f1-6167-4592-81be-b63ef6c1c8be tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:23.129682 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-fc9535f1-6167-4592-81be-b63ef6c1c8be tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:23.135815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc9535f1-6167-4592-81be-b63ef6c1c8be tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:23.136687 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc9535f1-6167-4592-81be-b63ef6c1c8be tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:23.136811 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc9535f1-6167-4592-81be-b63ef6c1c8be tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:23.137411 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc9535f1-6167-4592-81be-b63ef6c1c8be tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:23.137874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc9535f1-6167-4592-81be-b63ef6c1c8be tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:23.138325 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fc9535f1-6167-4592-81be-b63ef6c1c8be tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:23.199431 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-fc9535f1-6167-4592-81be-b63ef6c1c8be tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:23.207209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-fc9535f1-6167-4592-81be-b63ef6c1c8be tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1211 microversion: 2.1 time: 0.082265 Aug 22 12:55:23.207773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 384/768] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:23 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:24.234221 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-290ca2e3-a6e2-421b-819e-e8d2299e56d5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:24.234924 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-290ca2e3-a6e2-421b-819e-e8d2299e56d5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:24.241087 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-290ca2e3-a6e2-421b-819e-e8d2299e56d5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:24.241576 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-290ca2e3-a6e2-421b-819e-e8d2299e56d5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:24.242014 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-290ca2e3-a6e2-421b-819e-e8d2299e56d5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:24.243234 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-290ca2e3-a6e2-421b-819e-e8d2299e56d5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:24.243692 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-290ca2e3-a6e2-421b-819e-e8d2299e56d5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:24.244120 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-290ca2e3-a6e2-421b-819e-e8d2299e56d5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:24.297713 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-e385cb29-db4d-4182-92df-f3f242a530e5 req-0832c178-4438-414b-a118-08a8a29f2698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c83c81-7a50-4a24-a5c4-59c2af75792c", "tag": "c17bd0f3-f66e-4dd2-88c9-53a8231814ff"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:55:24.314538 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-e385cb29-db4d-4182-92df-f3f242a530e5 req-0832c178-4438-414b-a118-08a8a29f2698 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:24.315026 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-e385cb29-db4d-4182-92df-f3f242a530e5 req-0832c178-4438-414b-a118-08a8a29f2698 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:24.315466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-e385cb29-db4d-4182-92df-f3f242a530e5 req-0832c178-4438-414b-a118-08a8a29f2698 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:24.338010 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-e385cb29-db4d-4182-92df-f3f242a530e5 req-0832c178-4438-414b-a118-08a8a29f2698 service nova] Creating event network-changed:c17bd0f3-f66e-4dd2-88c9-53a8231814ff for instance a4c83c81-7a50-4a24-a5c4-59c2af75792c on hv-cinder-85083 Aug 22 12:55:24.345739 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-e385cb29-db4d-4182-92df-f3f242a530e5 req-0832c178-4438-414b-a118-08a8a29f2698 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051773 Aug 22 12:55:24.346399 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 385/769] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:55:24.416760 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-290ca2e3-a6e2-421b-819e-e8d2299e56d5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:24.430874 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-290ca2e3-a6e2-421b-819e-e8d2299e56d5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1279 microversion: 2.1 time: 0.195111 Aug 22 12:55:24.430874 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 385/770] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:24 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1279 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:25.445779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-eac53c33-5f4b-49b4-bfd7-4413e4a48a4a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:25.446504 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-eac53c33-5f4b-49b4-bfd7-4413e4a48a4a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:25.452587 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eac53c33-5f4b-49b4-bfd7-4413e4a48a4a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:25.453075 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eac53c33-5f4b-49b4-bfd7-4413e4a48a4a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:25.453514 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eac53c33-5f4b-49b4-bfd7-4413e4a48a4a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:25.454229 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eac53c33-5f4b-49b4-bfd7-4413e4a48a4a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:25.454691 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eac53c33-5f4b-49b4-bfd7-4413e4a48a4a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:25.455126 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-eac53c33-5f4b-49b4-bfd7-4413e4a48a4a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:25.597759 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-eac53c33-5f4b-49b4-bfd7-4413e4a48a4a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:25.605109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-eac53c33-5f4b-49b4-bfd7-4413e4a48a4a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1279 microversion: 2.1 time: 0.163845 Aug 22 12:55:25.605685 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 386/771] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:25 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:26.626273 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-acffdbd7-2a34-44d9-b8bf-c2ce027c20fb tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:26.626893 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-acffdbd7-2a34-44d9-b8bf-c2ce027c20fb tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:26.633345 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acffdbd7-2a34-44d9-b8bf-c2ce027c20fb tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:26.633834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acffdbd7-2a34-44d9-b8bf-c2ce027c20fb tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:26.634308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acffdbd7-2a34-44d9-b8bf-c2ce027c20fb tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:26.635016 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acffdbd7-2a34-44d9-b8bf-c2ce027c20fb tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:26.635474 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acffdbd7-2a34-44d9-b8bf-c2ce027c20fb tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:26.635902 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-acffdbd7-2a34-44d9-b8bf-c2ce027c20fb tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:26.765195 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-acffdbd7-2a34-44d9-b8bf-c2ce027c20fb tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:26.772772 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-acffdbd7-2a34-44d9-b8bf-c2ce027c20fb tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1279 microversion: 2.1 time: 0.150401 Aug 22 12:55:26.773373 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 386/772] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:26 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:27.793419 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-cb51d988-435c-4196-a846-cbf1510da80f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:27.794058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-cb51d988-435c-4196-a846-cbf1510da80f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:27.799960 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb51d988-435c-4196-a846-cbf1510da80f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:27.800445 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb51d988-435c-4196-a846-cbf1510da80f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:27.800879 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb51d988-435c-4196-a846-cbf1510da80f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:27.801561 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb51d988-435c-4196-a846-cbf1510da80f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:27.802011 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb51d988-435c-4196-a846-cbf1510da80f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:27.802462 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-cb51d988-435c-4196-a846-cbf1510da80f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:27.945519 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-cb51d988-435c-4196-a846-cbf1510da80f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:27.953988 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-cb51d988-435c-4196-a846-cbf1510da80f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1279 microversion: 2.1 time: 0.164962 Aug 22 12:55:27.954634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 387/773] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:27 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:28.975106 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a89b4412-dd77-4442-ac9a-5e78ff83aa1b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:28.975674 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a89b4412-dd77-4442-ac9a-5e78ff83aa1b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:28.982777 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a89b4412-dd77-4442-ac9a-5e78ff83aa1b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:28.988522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a89b4412-dd77-4442-ac9a-5e78ff83aa1b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:28.988522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a89b4412-dd77-4442-ac9a-5e78ff83aa1b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:28.988522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a89b4412-dd77-4442-ac9a-5e78ff83aa1b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:28.988522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a89b4412-dd77-4442-ac9a-5e78ff83aa1b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:28.988881 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a89b4412-dd77-4442-ac9a-5e78ff83aa1b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:29.122616 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a89b4412-dd77-4442-ac9a-5e78ff83aa1b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:29.130199 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a89b4412-dd77-4442-ac9a-5e78ff83aa1b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1279 microversion: 2.1 time: 0.159056 Aug 22 12:55:29.130775 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 387/774] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:28 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:30.156486 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4d1b2400-2830-4c8b-a0d4-01ee292359ad tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:30.157732 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4d1b2400-2830-4c8b-a0d4-01ee292359ad tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:30.160287 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:30.165382 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d1b2400-2830-4c8b-a0d4-01ee292359ad tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:30.165878 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d1b2400-2830-4c8b-a0d4-01ee292359ad tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:30.166389 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d1b2400-2830-4c8b-a0d4-01ee292359ad tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:30.167183 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d1b2400-2830-4c8b-a0d4-01ee292359ad tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:30.167672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d1b2400-2830-4c8b-a0d4-01ee292359ad tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:30.168099 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d1b2400-2830-4c8b-a0d4-01ee292359ad tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:30.302067 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-4d1b2400-2830-4c8b-a0d4-01ee292359ad tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:30.310663 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4d1b2400-2830-4c8b-a0d4-01ee292359ad tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1279 microversion: 2.1 time: 0.158543 Aug 22 12:55:30.311230 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 388/775] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:30 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:31.332630 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-14d83796-721d-48ec-8440-eee716ed873b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:31.333286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-14d83796-721d-48ec-8440-eee716ed873b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:31.335291 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:31.341046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d83796-721d-48ec-8440-eee716ed873b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:31.341524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d83796-721d-48ec-8440-eee716ed873b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:31.341951 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d83796-721d-48ec-8440-eee716ed873b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:31.342677 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d83796-721d-48ec-8440-eee716ed873b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:31.343127 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d83796-721d-48ec-8440-eee716ed873b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:31.343580 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-14d83796-721d-48ec-8440-eee716ed873b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:31.483258 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-14d83796-721d-48ec-8440-eee716ed873b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:31.490932 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-14d83796-721d-48ec-8440-eee716ed873b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1279 microversion: 2.1 time: 0.162160 Aug 22 12:55:31.491510 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 388/776] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:31 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:32.512046 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-33f7982d-6b29-4d9b-b008-3129533cd799 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:32.512633 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-33f7982d-6b29-4d9b-b008-3129533cd799 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:32.514471 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=8 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:32.519616 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-33f7982d-6b29-4d9b-b008-3129533cd799 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:32.520102 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-33f7982d-6b29-4d9b-b008-3129533cd799 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:32.520537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-33f7982d-6b29-4d9b-b008-3129533cd799 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:32.521230 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-33f7982d-6b29-4d9b-b008-3129533cd799 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:32.521686 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-33f7982d-6b29-4d9b-b008-3129533cd799 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:32.522121 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-33f7982d-6b29-4d9b-b008-3129533cd799 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:32.656078 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-33f7982d-6b29-4d9b-b008-3129533cd799 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:32.663641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-33f7982d-6b29-4d9b-b008-3129533cd799 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.155590 Aug 22 12:55:32.664208 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 389/777] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:32 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:33.686095 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8759672f-1316-495a-99c3-87080e62e8d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:33.686666 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8759672f-1316-495a-99c3-87080e62e8d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:33.693041 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8759672f-1316-495a-99c3-87080e62e8d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:33.693518 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8759672f-1316-495a-99c3-87080e62e8d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:33.693950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8759672f-1316-495a-99c3-87080e62e8d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:33.694667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8759672f-1316-495a-99c3-87080e62e8d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:33.695120 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8759672f-1316-495a-99c3-87080e62e8d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:33.695538 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8759672f-1316-495a-99c3-87080e62e8d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:33.823283 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8759672f-1316-495a-99c3-87080e62e8d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:33.830992 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8759672f-1316-495a-99c3-87080e62e8d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.149886 Aug 22 12:55:33.831553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 389/778] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:33 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:34.855516 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b0680556-9d9d-4f0c-ae4d-0dac6a5a6991 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:34.856139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b0680556-9d9d-4f0c-ae4d-0dac6a5a6991 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:34.862615 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0680556-9d9d-4f0c-ae4d-0dac6a5a6991 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:34.863109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0680556-9d9d-4f0c-ae4d-0dac6a5a6991 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:34.863548 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0680556-9d9d-4f0c-ae4d-0dac6a5a6991 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:34.864243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0680556-9d9d-4f0c-ae4d-0dac6a5a6991 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:34.864702 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0680556-9d9d-4f0c-ae4d-0dac6a5a6991 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:34.865127 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0680556-9d9d-4f0c-ae4d-0dac6a5a6991 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:34.997119 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b0680556-9d9d-4f0c-ae4d-0dac6a5a6991 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:35.005065 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b0680556-9d9d-4f0c-ae4d-0dac6a5a6991 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.153685 Aug 22 12:55:35.005633 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 390/779] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:34 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:36.025901 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8c18314a-40ab-4af2-a0c1-f62dcc66f850 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:36.026544 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8c18314a-40ab-4af2-a0c1-f62dcc66f850 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:36.032894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c18314a-40ab-4af2-a0c1-f62dcc66f850 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:36.033384 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c18314a-40ab-4af2-a0c1-f62dcc66f850 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:36.033823 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c18314a-40ab-4af2-a0c1-f62dcc66f850 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:36.034554 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c18314a-40ab-4af2-a0c1-f62dcc66f850 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:36.035072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c18314a-40ab-4af2-a0c1-f62dcc66f850 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:36.035504 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8c18314a-40ab-4af2-a0c1-f62dcc66f850 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:36.166476 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8c18314a-40ab-4af2-a0c1-f62dcc66f850 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:36.174072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8c18314a-40ab-4af2-a0c1-f62dcc66f850 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.152090 Aug 22 12:55:36.174873 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 390/780] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:36 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:37.195219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1f6df233-e51f-40ed-9f89-902ee484ff24 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:37.195831 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1f6df233-e51f-40ed-9f89-902ee484ff24 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:37.202732 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1f6df233-e51f-40ed-9f89-902ee484ff24 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:37.203223 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1f6df233-e51f-40ed-9f89-902ee484ff24 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:37.203662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1f6df233-e51f-40ed-9f89-902ee484ff24 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:37.204367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1f6df233-e51f-40ed-9f89-902ee484ff24 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:37.204829 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1f6df233-e51f-40ed-9f89-902ee484ff24 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:37.205265 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1f6df233-e51f-40ed-9f89-902ee484ff24 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:37.335899 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1f6df233-e51f-40ed-9f89-902ee484ff24 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:37.344138 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1f6df233-e51f-40ed-9f89-902ee484ff24 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.152804 Aug 22 12:55:37.344701 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 391/781] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:37 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:38.364992 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-96b9214c-77d3-4582-a58c-8ca12e73aaf0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:38.365652 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-96b9214c-77d3-4582-a58c-8ca12e73aaf0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:38.372068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-96b9214c-77d3-4582-a58c-8ca12e73aaf0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:38.372553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-96b9214c-77d3-4582-a58c-8ca12e73aaf0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:38.372988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-96b9214c-77d3-4582-a58c-8ca12e73aaf0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:38.373680 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-96b9214c-77d3-4582-a58c-8ca12e73aaf0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:38.374140 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-96b9214c-77d3-4582-a58c-8ca12e73aaf0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:38.374589 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-96b9214c-77d3-4582-a58c-8ca12e73aaf0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:38.504894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-96b9214c-77d3-4582-a58c-8ca12e73aaf0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:38.512416 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-96b9214c-77d3-4582-a58c-8ca12e73aaf0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.151406 Aug 22 12:55:38.512975 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 391/782] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:38 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:39.532789 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b10bce42-2e7e-4227-9087-9d3e55431a15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:39.533409 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b10bce42-2e7e-4227-9087-9d3e55431a15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:39.539781 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b10bce42-2e7e-4227-9087-9d3e55431a15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:39.540210 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b10bce42-2e7e-4227-9087-9d3e55431a15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:39.540642 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b10bce42-2e7e-4227-9087-9d3e55431a15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:39.541333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b10bce42-2e7e-4227-9087-9d3e55431a15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:39.541785 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b10bce42-2e7e-4227-9087-9d3e55431a15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:39.542238 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b10bce42-2e7e-4227-9087-9d3e55431a15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:39.671152 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b10bce42-2e7e-4227-9087-9d3e55431a15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:39.678848 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b10bce42-2e7e-4227-9087-9d3e55431a15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.150023 Aug 22 12:55:39.679414 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 392/783] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:39 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:40.700422 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-4b289381-d307-47b2-8d2f-feb3d4ed130d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:40.701599 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-4b289381-d307-47b2-8d2f-feb3d4ed130d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:40.707955 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b289381-d307-47b2-8d2f-feb3d4ed130d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:40.708443 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b289381-d307-47b2-8d2f-feb3d4ed130d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:40.708878 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b289381-d307-47b2-8d2f-feb3d4ed130d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:40.709596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b289381-d307-47b2-8d2f-feb3d4ed130d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:40.710028 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b289381-d307-47b2-8d2f-feb3d4ed130d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:40.710475 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b289381-d307-47b2-8d2f-feb3d4ed130d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:40.842088 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4b289381-d307-47b2-8d2f-feb3d4ed130d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:40.849846 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-4b289381-d307-47b2-8d2f-feb3d4ed130d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.153344 Aug 22 12:55:40.850451 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 392/784] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:40 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:41.871102 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-9175bf91-ad72-4c4b-975b-a03b50453b89 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:41.871672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-9175bf91-ad72-4c4b-975b-a03b50453b89 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:41.878541 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9175bf91-ad72-4c4b-975b-a03b50453b89 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:41.879019 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9175bf91-ad72-4c4b-975b-a03b50453b89 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:41.879449 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9175bf91-ad72-4c4b-975b-a03b50453b89 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:41.880133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9175bf91-ad72-4c4b-975b-a03b50453b89 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:41.880581 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9175bf91-ad72-4c4b-975b-a03b50453b89 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:41.881001 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9175bf91-ad72-4c4b-975b-a03b50453b89 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:42.016580 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9175bf91-ad72-4c4b-975b-a03b50453b89 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:42.024327 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-9175bf91-ad72-4c4b-975b-a03b50453b89 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.157105 Aug 22 12:55:42.026324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 393/785] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:41 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:43.046097 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-94048156-015a-4c68-941c-62cda4726155 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:43.046744 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-94048156-015a-4c68-941c-62cda4726155 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:43.053307 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-94048156-015a-4c68-941c-62cda4726155 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:43.053798 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-94048156-015a-4c68-941c-62cda4726155 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:43.054260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-94048156-015a-4c68-941c-62cda4726155 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:43.054974 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-94048156-015a-4c68-941c-62cda4726155 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:43.055439 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-94048156-015a-4c68-941c-62cda4726155 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:43.055861 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-94048156-015a-4c68-941c-62cda4726155 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:43.184966 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-94048156-015a-4c68-941c-62cda4726155 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:43.192500 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-94048156-015a-4c68-941c-62cda4726155 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.150834 Aug 22 12:55:43.193068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 393/786] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:43 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:44.213780 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4c5f972e-0448-49b1-9d7c-afe1d80128e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:44.214433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4c5f972e-0448-49b1-9d7c-afe1d80128e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:44.220987 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c5f972e-0448-49b1-9d7c-afe1d80128e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:44.221514 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c5f972e-0448-49b1-9d7c-afe1d80128e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:44.221967 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c5f972e-0448-49b1-9d7c-afe1d80128e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:44.222725 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c5f972e-0448-49b1-9d7c-afe1d80128e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:44.223183 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c5f972e-0448-49b1-9d7c-afe1d80128e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:44.223609 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c5f972e-0448-49b1-9d7c-afe1d80128e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:44.356834 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-4c5f972e-0448-49b1-9d7c-afe1d80128e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:44.364640 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4c5f972e-0448-49b1-9d7c-afe1d80128e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.154923 Aug 22 12:55:44.365220 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 394/787] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:44 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:45.385393 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8e29464c-dee1-4791-a859-b6c04f2c1dde tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:45.385934 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8e29464c-dee1-4791-a859-b6c04f2c1dde tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:45.392908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e29464c-dee1-4791-a859-b6c04f2c1dde tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:45.393393 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e29464c-dee1-4791-a859-b6c04f2c1dde tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:45.393823 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e29464c-dee1-4791-a859-b6c04f2c1dde tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:45.394543 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e29464c-dee1-4791-a859-b6c04f2c1dde tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:45.394995 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e29464c-dee1-4791-a859-b6c04f2c1dde tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:45.395413 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e29464c-dee1-4791-a859-b6c04f2c1dde tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:45.524414 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8e29464c-dee1-4791-a859-b6c04f2c1dde tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:45.532884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8e29464c-dee1-4791-a859-b6c04f2c1dde tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.151397 Aug 22 12:55:45.533444 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 394/788] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:45 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:46.233091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-0dc96b26-61d5-4ede-8692-56fd272c5ac0 req-bc1fd1e3-3715-4c3f-9022-a8f85da2a589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c83c81-7a50-4a24-a5c4-59c2af75792c", "name": "network-vif-plugged", "status": "completed", "tag": "c17bd0f3-f66e-4dd2-88c9-53a8231814ff"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:55:46.243070 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-0dc96b26-61d5-4ede-8692-56fd272c5ac0 req-bc1fd1e3-3715-4c3f-9022-a8f85da2a589 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:46.243949 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-0dc96b26-61d5-4ede-8692-56fd272c5ac0 req-bc1fd1e3-3715-4c3f-9022-a8f85da2a589 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:46.244072 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-0dc96b26-61d5-4ede-8692-56fd272c5ac0 req-bc1fd1e3-3715-4c3f-9022-a8f85da2a589 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:46.255364 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-0dc96b26-61d5-4ede-8692-56fd272c5ac0 req-bc1fd1e3-3715-4c3f-9022-a8f85da2a589 service nova] Creating event network-vif-plugged:c17bd0f3-f66e-4dd2-88c9-53a8231814ff for instance a4c83c81-7a50-4a24-a5c4-59c2af75792c on hv-cinder-85083 Aug 22 12:55:46.260284 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-0dc96b26-61d5-4ede-8692-56fd272c5ac0 req-bc1fd1e3-3715-4c3f-9022-a8f85da2a589 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031640 Aug 22 12:55:46.261301 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 395/789] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:55:46.553563 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-262a374d-ac34-4ac2-82d2-9f5771144715 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:46.554203 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-262a374d-ac34-4ac2-82d2-9f5771144715 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:46.561215 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-262a374d-ac34-4ac2-82d2-9f5771144715 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:46.561948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-262a374d-ac34-4ac2-82d2-9f5771144715 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:46.562421 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-262a374d-ac34-4ac2-82d2-9f5771144715 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:46.563135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-262a374d-ac34-4ac2-82d2-9f5771144715 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:46.563598 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-262a374d-ac34-4ac2-82d2-9f5771144715 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:46.564029 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-262a374d-ac34-4ac2-82d2-9f5771144715 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:46.698983 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-262a374d-ac34-4ac2-82d2-9f5771144715 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:46.706506 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-262a374d-ac34-4ac2-82d2-9f5771144715 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.156920 Aug 22 12:55:46.707069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 395/790] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:46 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:47.727660 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-384423bb-e97c-4735-b2fc-a7955cbd8678 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:47.728269 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-384423bb-e97c-4735-b2fc-a7955cbd8678 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:47.735810 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-384423bb-e97c-4735-b2fc-a7955cbd8678 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:47.736297 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-384423bb-e97c-4735-b2fc-a7955cbd8678 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:47.736727 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-384423bb-e97c-4735-b2fc-a7955cbd8678 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:47.737507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-384423bb-e97c-4735-b2fc-a7955cbd8678 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:47.738007 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-384423bb-e97c-4735-b2fc-a7955cbd8678 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:47.738550 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-384423bb-e97c-4735-b2fc-a7955cbd8678 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:47.870767 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-384423bb-e97c-4735-b2fc-a7955cbd8678 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:47.878955 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-384423bb-e97c-4735-b2fc-a7955cbd8678 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1267 microversion: 2.1 time: 0.155587 Aug 22 12:55:47.879524 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 396/791] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:47 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:48.190539 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-187951a2-93f5-405e-812a-f2067fa2043e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:48.194341 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-187951a2-93f5-405e-812a-f2067fa2043e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:48.197657 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-187951a2-93f5-405e-812a-f2067fa2043e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:48.198139 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-187951a2-93f5-405e-812a-f2067fa2043e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:48.198607 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-187951a2-93f5-405e-812a-f2067fa2043e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:48.199293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-187951a2-93f5-405e-812a-f2067fa2043e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:48.199745 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-187951a2-93f5-405e-812a-f2067fa2043e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:48.200165 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-187951a2-93f5-405e-812a-f2067fa2043e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:48.282096 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-187951a2-93f5-405e-812a-f2067fa2043e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lazy-loading 'services' on Instance uuid 767b4644-c6d4-43ec-8dd7-24417f247866 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:55:48.476215 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-187951a2-93f5-405e-812a-f2067fa2043e tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "DELETE /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866/os-volume_attachments/69db5ed1-9fb2-4946-99ec-3ac3793cb3fe" status: 202 len: 0 microversion: 2.1 time: 0.289371 Aug 22 12:55:48.476744 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 396/792] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 12:55:48 2022] DELETE /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866/os-volume_attachments/69db5ed1-9fb2-4946-99ec-3ac3793cb3fe => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:55:48.899578 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-561349b5-fbb2-4fce-a698-843465179d00 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:48.900255 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-561349b5-fbb2-4fce-a698-843465179d00 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:48.902761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:48.907452 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-561349b5-fbb2-4fce-a698-843465179d00 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:48.907935 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-561349b5-fbb2-4fce-a698-843465179d00 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:48.908368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-561349b5-fbb2-4fce-a698-843465179d00 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:48.909049 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-561349b5-fbb2-4fce-a698-843465179d00 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:48.909499 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-561349b5-fbb2-4fce-a698-843465179d00 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:48.909917 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-561349b5-fbb2-4fce-a698-843465179d00 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:48.913849 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=79 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:49.041994 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-561349b5-fbb2-4fce-a698-843465179d00 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:49.052546 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-561349b5-fbb2-4fce-a698-843465179d00 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1454 microversion: 2.1 time: 0.156744 Aug 22 12:55:49.053133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 397/793] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:48 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:49.073537 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9fe4af9e-94d4-4d1f-a8ba-1bfe2b7bdc60 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:49.074286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9fe4af9e-94d4-4d1f-a8ba-1bfe2b7bdc60 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:49.081038 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fe4af9e-94d4-4d1f-a8ba-1bfe2b7bdc60 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:49.081532 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fe4af9e-94d4-4d1f-a8ba-1bfe2b7bdc60 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:49.081980 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fe4af9e-94d4-4d1f-a8ba-1bfe2b7bdc60 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:49.082710 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fe4af9e-94d4-4d1f-a8ba-1bfe2b7bdc60 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:49.083169 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fe4af9e-94d4-4d1f-a8ba-1bfe2b7bdc60 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:49.083597 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fe4af9e-94d4-4d1f-a8ba-1bfe2b7bdc60 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:49.225573 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-9fe4af9e-94d4-4d1f-a8ba-1bfe2b7bdc60 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:49.235225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9fe4af9e-94d4-4d1f-a8ba-1bfe2b7bdc60 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1454 microversion: 2.1 time: 0.164552 Aug 22 12:55:49.235225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 397/794] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:49 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:49.599933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2d475b13-14aa-490a-985f-40ef4b417e87 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:49.600514 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2d475b13-14aa-490a-985f-40ef4b417e87 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:49.607792 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d475b13-14aa-490a-985f-40ef4b417e87 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:49.608289 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d475b13-14aa-490a-985f-40ef4b417e87 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:49.608727 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d475b13-14aa-490a-985f-40ef4b417e87 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:49.609442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d475b13-14aa-490a-985f-40ef4b417e87 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:49.609896 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d475b13-14aa-490a-985f-40ef4b417e87 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:49.610407 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2d475b13-14aa-490a-985f-40ef4b417e87 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:49.786843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2d475b13-14aa-490a-985f-40ef4b417e87 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Going to try to terminate instance {{(pid=127810) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:55:50.009126 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2d475b13-14aa-490a-985f-40ef4b417e87 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "DELETE /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 204 len: 0 microversion: 2.1 time: 0.412847 Aug 22 12:55:50.010039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 398/795] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:55:49 2022] DELETE /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:55:50.024726 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f7c3d047-2e7b-4ec0-9c39-727672f0b895 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:50.025886 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f7c3d047-2e7b-4ec0-9c39-727672f0b895 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:50.036007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f7c3d047-2e7b-4ec0-9c39-727672f0b895 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:50.036512 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f7c3d047-2e7b-4ec0-9c39-727672f0b895 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:50.037005 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f7c3d047-2e7b-4ec0-9c39-727672f0b895 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:50.037696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f7c3d047-2e7b-4ec0-9c39-727672f0b895 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:50.038157 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f7c3d047-2e7b-4ec0-9c39-727672f0b895 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:50.038615 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f7c3d047-2e7b-4ec0-9c39-727672f0b895 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:50.057453 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:50.255772 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f7c3d047-2e7b-4ec0-9c39-727672f0b895 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:50.263469 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f7c3d047-2e7b-4ec0-9c39-727672f0b895 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1513 microversion: 2.1 time: 0.246876 Aug 22 12:55:50.264047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 398/796] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:50 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:55:51.286142 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-049eecb9-d65f-48d6-9c69-4cebde068741 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:51.286858 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-049eecb9-d65f-48d6-9c69-4cebde068741 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:51.293451 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-049eecb9-d65f-48d6-9c69-4cebde068741 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:51.293943 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-049eecb9-d65f-48d6-9c69-4cebde068741 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:51.294994 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-049eecb9-d65f-48d6-9c69-4cebde068741 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:51.295694 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-049eecb9-d65f-48d6-9c69-4cebde068741 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:51.296152 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-049eecb9-d65f-48d6-9c69-4cebde068741 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:51.296576 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-049eecb9-d65f-48d6-9c69-4cebde068741 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:51.501908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-049eecb9-d65f-48d6-9c69-4cebde068741 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:51.509608 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-049eecb9-d65f-48d6-9c69-4cebde068741 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1513 microversion: 2.1 time: 0.227768 Aug 22 12:55:51.510158 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 399/797] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:51 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:51.664214 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-6458df4c-ab71-498e-b8c0-94bc36b530ba req-2dcec6f3-4945-43d0-8a13-b6a792543a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c83c81-7a50-4a24-a5c4-59c2af75792c", "tag": "c17bd0f3-f66e-4dd2-88c9-53a8231814ff"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:55:51.670420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=35 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:51.676612 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-6458df4c-ab71-498e-b8c0-94bc36b530ba req-2dcec6f3-4945-43d0-8a13-b6a792543a70 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:51.677189 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-6458df4c-ab71-498e-b8c0-94bc36b530ba req-2dcec6f3-4945-43d0-8a13-b6a792543a70 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:51.677530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-6458df4c-ab71-498e-b8c0-94bc36b530ba req-2dcec6f3-4945-43d0-8a13-b6a792543a70 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:51.689895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-6458df4c-ab71-498e-b8c0-94bc36b530ba req-2dcec6f3-4945-43d0-8a13-b6a792543a70 service nova] Creating event network-changed:c17bd0f3-f66e-4dd2-88c9-53a8231814ff for instance a4c83c81-7a50-4a24-a5c4-59c2af75792c on hv-cinder-85083 Aug 22 12:55:51.694876 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-6458df4c-ab71-498e-b8c0-94bc36b530ba req-2dcec6f3-4945-43d0-8a13-b6a792543a70 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034325 Aug 22 12:55:51.695499 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 399/798] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:55:52.455859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-42679c82-0cc3-4ea8-9498-b9f59e8aa2aa req-aa91d3fc-611d-4846-b80d-3bbc7ac0f008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "767b4644-c6d4-43ec-8dd7-24417f247866", "name": "network-vif-deleted", "tag": "8ed9475f-2ecd-4b57-a670-dc71e33b3a2f"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:55:52.466738 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-42679c82-0cc3-4ea8-9498-b9f59e8aa2aa req-aa91d3fc-611d-4846-b80d-3bbc7ac0f008 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:52.473413 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-42679c82-0cc3-4ea8-9498-b9f59e8aa2aa req-aa91d3fc-611d-4846-b80d-3bbc7ac0f008 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:52.473413 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-42679c82-0cc3-4ea8-9498-b9f59e8aa2aa req-aa91d3fc-611d-4846-b80d-3bbc7ac0f008 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:52.487041 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-42679c82-0cc3-4ea8-9498-b9f59e8aa2aa req-aa91d3fc-611d-4846-b80d-3bbc7ac0f008 service nova] Creating event network-vif-deleted:8ed9475f-2ecd-4b57-a670-dc71e33b3a2f for instance 767b4644-c6d4-43ec-8dd7-24417f247866 on hv-cinder-85083 Aug 22 12:55:52.492105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-42679c82-0cc3-4ea8-9498-b9f59e8aa2aa req-aa91d3fc-611d-4846-b80d-3bbc7ac0f008 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039861 Aug 22 12:55:52.492751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 400/799] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:55:52.532654 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-026cb55a-ad83-4e9b-85d8-d59583098fc5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:52.533336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-026cb55a-ad83-4e9b-85d8-d59583098fc5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:52.540232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-026cb55a-ad83-4e9b-85d8-d59583098fc5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:52.540731 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-026cb55a-ad83-4e9b-85d8-d59583098fc5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:52.541165 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-026cb55a-ad83-4e9b-85d8-d59583098fc5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:52.541871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-026cb55a-ad83-4e9b-85d8-d59583098fc5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:52.542371 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-026cb55a-ad83-4e9b-85d8-d59583098fc5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:52.542800 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-026cb55a-ad83-4e9b-85d8-d59583098fc5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:52.609551 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-026cb55a-ad83-4e9b-85d8-d59583098fc5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:52.617455 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-026cb55a-ad83-4e9b-85d8-d59583098fc5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 200 len: 1471 microversion: 2.1 time: 0.089905 Aug 22 12:55:52.618029 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 400/800] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:52 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:53.640457 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:53.641160 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 767b4644-c6d4-43ec-8dd7-24417f247866] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:53.647422 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:53.647910 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:53.648341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:53.649033 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:53.649526 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:53.649950 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:53.662928 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] HTTP exception thrown: Instance 767b4644-c6d4-43ec-8dd7-24417f247866 could not be found. Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Request method failure captured: Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 HTTP/1.1 Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3yPyoFLyTLJJt0T4mta8OumawdaZ8v__XKkc9aFtct3FhH3n4ubZe7Zhbo1qjDDxOuYT1X_BnSpzxzC2DKvkg0W0aZCAlQj0u6LpPECpUbpOxTg3FdsyISaIGCPOwErZqNSbianaVxrfG57FuaNNOnWv-QE23abzoHbV6--PI3pAD4 Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 2ad064334a6e49719a1162b53a6b7b0e Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-VolumesSnapshotTestJSON-67694960 Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:55:53.664659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2ad064334a6e49719a1162b53a6b7b0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2ad064334a6e49719a1162b53a6b7b0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2ad064334a6e49719a1162b53a6b7b0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2ad064334a6e49719a1162b53a6b7b0e"}]}] Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-VolumesSnapshotTestJSON-67694960 Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 2ad064334a6e49719a1162b53a6b7b0e Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-67694960 Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-VolumesSnapshotTestJSON-67694960-project Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: ee6b61e59be8455bb272c97b040684d4 Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-VolumesSnapshotTestJSON-67694960-project Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 767b4644-c6d4-43ec-8dd7-24417f247866 could not be found. Aug 22 12:55:53.666424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '767b4644-c6d4-43ec-8dd7-24417f247866'} Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 767b4644-c6d4-43ec-8dd7-24417f247866 could not be found. Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:55:53.667442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 767b4644-c6d4-43ec-8dd7-24417f247866 could not be found. Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 767b4644-c6d4-43ec-8dd7-24417f247866 could not be found. Aug 22 12:55:53.669627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:55:53.671262 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Returning 404 to user: Instance 767b4644-c6d4-43ec-8dd7-24417f247866 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:55:53.671262 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ec7ab258-0db9-4044-bbf1-23d583678066 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866" status: 404 len: 111 microversion: 2.1 time: 0.031070 Aug 22 12:55:53.671262 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 401/801] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:53 2022] GET /compute/v2.1/servers/767b4644-c6d4-43ec-8dd7-24417f247866 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:55:54.738077 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2569455d-d687-40a9-b5dd-e6f895c84d35 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:54.738607 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2569455d-d687-40a9-b5dd-e6f895c84d35 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:54.744997 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2569455d-d687-40a9-b5dd-e6f895c84d35 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:54.752000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2569455d-d687-40a9-b5dd-e6f895c84d35 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:54.752000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2569455d-d687-40a9-b5dd-e6f895c84d35 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:54.752000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2569455d-d687-40a9-b5dd-e6f895c84d35 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:54.752000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2569455d-d687-40a9-b5dd-e6f895c84d35 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:54.752380 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2569455d-d687-40a9-b5dd-e6f895c84d35 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:54.769892 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2569455d-d687-40a9-b5dd-e6f895c84d35 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a/ips" status: 200 len: 150 microversion: 2.1 time: 0.035686 Aug 22 12:55:54.770547 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 401/802] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 22 12:55:54 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:55:54.782965 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adcdcfe7-5eb5-4939-8aab-aace8368fbda"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:55:54.785233 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:54.791552 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:54.792031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:54.792462 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:54.793143 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:54.793592 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:54.794068 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:54.873440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Invalid volume: volume adcdcfe7-5eb5-4939-8aab-aace8368fbda is already attached to instances: 746985f5-95e3-4ad2-a997-67653768dfd3 Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: POST /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a/os-volume_attachments HTTP/1.1 Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 74 Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:55:54.875257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {"volumeAttachment": {"volumeId": "adcdcfe7-5eb5-4939-8aab-aace8368fbda"}} Aug 22 12:55:54.876787 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Invalid volume: volume adcdcfe7-5eb5-4939-8aab-aace8368fbda is already attached to instances: 746985f5-95e3-4ad2-a997-67653768dfd3 Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'server_id': '40c9cb84-5a6e-46f5-a67a-ba8cc838829a', 'body': {'volumeAttachment': {'volumeId': 'adcdcfe7-5eb5-4939-8aab-aace8368fbda'}}} Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume adcdcfe7-5eb5-4939-8aab-aace8368fbda is already attached to instances: 746985f5-95e3-4ad2-a997-67653768dfd3 Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:55:54.877671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume adcdcfe7-5eb5-4939-8aab-aace8368fbda is already attached to instances: 746985f5-95e3-4ad2-a997-67653768dfd3 Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:55:54.879207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:55:54.880895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:55:54.880895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:55:54.880895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:55:54.880895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume adcdcfe7-5eb5-4939-8aab-aace8368fbda is already attached to instances: 746985f5-95e3-4ad2-a997-67653768dfd3 Aug 22 12:55:54.880895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:55:54.880895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 400 to user: Invalid volume: volume adcdcfe7-5eb5-4939-8aab-aace8368fbda is already attached to instances: 746985f5-95e3-4ad2-a997-67653768dfd3 {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:55:54.880895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-319bad9b-8e9a-4aef-9b54-3590947add98 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098193 Aug 22 12:55:54.880895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 402/803] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:55:54 2022] POST /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 12:55:54.885231 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b5a62e1f-b966-4fed-af9f-583ba63f4c08 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:54.885724 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b5a62e1f-b966-4fed-af9f-583ba63f4c08 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:54.891603 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5a62e1f-b966-4fed-af9f-583ba63f4c08 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:54.895191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5a62e1f-b966-4fed-af9f-583ba63f4c08 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:54.895191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5a62e1f-b966-4fed-af9f-583ba63f4c08 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:54.895191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5a62e1f-b966-4fed-af9f-583ba63f4c08 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:54.895191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5a62e1f-b966-4fed-af9f-583ba63f4c08 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:54.895569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b5a62e1f-b966-4fed-af9f-583ba63f4c08 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:54.925684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b5a62e1f-b966-4fed-af9f-583ba63f4c08 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:55:55.214013 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b5a62e1f-b966-4fed-af9f-583ba63f4c08 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 204 len: 0 microversion: 2.1 time: 0.332181 Aug 22 12:55:55.214649 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 402/804] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:55:54 2022] DELETE /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:55:55.223785 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3214e612-b7a7-4494-a5e0-8d7bed0f1560 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:55.224562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3214e612-b7a7-4494-a5e0-8d7bed0f1560 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:55.232016 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3214e612-b7a7-4494-a5e0-8d7bed0f1560 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:55.232492 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3214e612-b7a7-4494-a5e0-8d7bed0f1560 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:55.232917 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3214e612-b7a7-4494-a5e0-8d7bed0f1560 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:55.233597 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3214e612-b7a7-4494-a5e0-8d7bed0f1560 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:55.234047 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3214e612-b7a7-4494-a5e0-8d7bed0f1560 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:55.234512 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3214e612-b7a7-4494-a5e0-8d7bed0f1560 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:55.365440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3214e612-b7a7-4494-a5e0-8d7bed0f1560 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:55.373127 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3214e612-b7a7-4494-a5e0-8d7bed0f1560 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1682 microversion: 2.1 time: 0.153541 Aug 22 12:55:55.373682 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 403/805] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:55 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:56.394649 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b055bf1f-50c8-429d-b9ae-af8ec5b717e0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:56.395350 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b055bf1f-50c8-429d-b9ae-af8ec5b717e0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:56.401871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b055bf1f-50c8-429d-b9ae-af8ec5b717e0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:56.402410 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b055bf1f-50c8-429d-b9ae-af8ec5b717e0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:56.402891 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b055bf1f-50c8-429d-b9ae-af8ec5b717e0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:56.404083 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b055bf1f-50c8-429d-b9ae-af8ec5b717e0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:56.404538 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b055bf1f-50c8-429d-b9ae-af8ec5b717e0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:56.404961 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b055bf1f-50c8-429d-b9ae-af8ec5b717e0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:56.533315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b055bf1f-50c8-429d-b9ae-af8ec5b717e0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:56.541076 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b055bf1f-50c8-429d-b9ae-af8ec5b717e0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1682 microversion: 2.1 time: 0.150600 Aug 22 12:55:56.541577 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 403/806] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:56 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:57.562901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-71de1d47-b73b-4a78-a243-786baba52642 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:57.563513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-71de1d47-b73b-4a78-a243-786baba52642 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:57.569637 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71de1d47-b73b-4a78-a243-786baba52642 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:57.570118 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71de1d47-b73b-4a78-a243-786baba52642 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:57.570590 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71de1d47-b73b-4a78-a243-786baba52642 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:57.571277 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71de1d47-b73b-4a78-a243-786baba52642 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:57.571726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71de1d47-b73b-4a78-a243-786baba52642 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:57.572145 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-71de1d47-b73b-4a78-a243-786baba52642 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:57.702414 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-71de1d47-b73b-4a78-a243-786baba52642 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:57.709968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-71de1d47-b73b-4a78-a243-786baba52642 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1682 microversion: 2.1 time: 0.151664 Aug 22 12:55:57.710557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 404/807] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:57 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:58.732510 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-04d8c642-df12-43a0-b962-aeadc922bffb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:58.733204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-04d8c642-df12-43a0-b962-aeadc922bffb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:58.739834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d8c642-df12-43a0-b962-aeadc922bffb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:58.743317 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d8c642-df12-43a0-b962-aeadc922bffb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:58.743317 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d8c642-df12-43a0-b962-aeadc922bffb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:58.743317 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d8c642-df12-43a0-b962-aeadc922bffb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:58.743317 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d8c642-df12-43a0-b962-aeadc922bffb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:58.743707 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-04d8c642-df12-43a0-b962-aeadc922bffb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:58.898203 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-04d8c642-df12-43a0-b962-aeadc922bffb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:55:58.906662 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-04d8c642-df12-43a0-b962-aeadc922bffb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1682 microversion: 2.1 time: 0.178836 Aug 22 12:55:58.910282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 404/808] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:58 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:55:59.317875 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-824f8c14-6c1d-429c-a36b-aaffaf3355f6 req-c1542f25-13e3-4d28-8832-e42c86f60243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c9cb84-5a6e-46f5-a67a-ba8cc838829a", "name": "network-vif-deleted", "tag": "6be1384d-f5c4-4789-8d5e-b39dec57ee4a"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:55:59.327532 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-824f8c14-6c1d-429c-a36b-aaffaf3355f6 req-c1542f25-13e3-4d28-8832-e42c86f60243 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:59.329266 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-824f8c14-6c1d-429c-a36b-aaffaf3355f6 req-c1542f25-13e3-4d28-8832-e42c86f60243 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:59.329266 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-824f8c14-6c1d-429c-a36b-aaffaf3355f6 req-c1542f25-13e3-4d28-8832-e42c86f60243 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:59.339552 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-824f8c14-6c1d-429c-a36b-aaffaf3355f6 req-c1542f25-13e3-4d28-8832-e42c86f60243 service nova] Creating event network-vif-deleted:6be1384d-f5c4-4789-8d5e-b39dec57ee4a for instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a on hv-cinder-85083 Aug 22 12:55:59.345227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-824f8c14-6c1d-429c-a36b-aaffaf3355f6 req-c1542f25-13e3-4d28-8832-e42c86f60243 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030993 Aug 22 12:55:59.352192 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 405/809] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:55:59.927850 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7910974a-1a4e-4973-a9b3-75d65d7e3fdd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:55:59.928559 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7910974a-1a4e-4973-a9b3-75d65d7e3fdd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:55:59.935025 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7910974a-1a4e-4973-a9b3-75d65d7e3fdd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:59.936125 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7910974a-1a4e-4973-a9b3-75d65d7e3fdd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:59.936697 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7910974a-1a4e-4973-a9b3-75d65d7e3fdd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:55:59.937473 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7910974a-1a4e-4973-a9b3-75d65d7e3fdd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:55:59.938007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7910974a-1a4e-4973-a9b3-75d65d7e3fdd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:55:59.938467 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7910974a-1a4e-4973-a9b3-75d65d7e3fdd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:00.002260 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7910974a-1a4e-4973-a9b3-75d65d7e3fdd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:00.011542 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7910974a-1a4e-4973-a9b3-75d65d7e3fdd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1615 microversion: 2.1 time: 0.087430 Aug 22 12:56:00.012204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 405/810] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:55:59 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:01.034989 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-44c426af-54fe-45ca-987d-9ab193d0f38a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:01.035702 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-44c426af-54fe-45ca-987d-9ab193d0f38a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:01.041707 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44c426af-54fe-45ca-987d-9ab193d0f38a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:01.042243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44c426af-54fe-45ca-987d-9ab193d0f38a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:01.042678 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44c426af-54fe-45ca-987d-9ab193d0f38a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:01.043362 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44c426af-54fe-45ca-987d-9ab193d0f38a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:01.043818 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44c426af-54fe-45ca-987d-9ab193d0f38a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:01.044233 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-44c426af-54fe-45ca-987d-9ab193d0f38a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:01.109443 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-44c426af-54fe-45ca-987d-9ab193d0f38a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:01.117300 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-44c426af-54fe-45ca-987d-9ab193d0f38a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1615 microversion: 2.1 time: 0.087010 Aug 22 12:56:01.117859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 406/811] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:01 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:02.057455 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1884714719", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "networks": [{"uuid": "d47ee9a6-d88d-481a-b70f-2bd9bed1ea50"}]}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:56:02.112388 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] validate_networks() for [('d47ee9a6-d88d-481a-b70f-2bd9bed1ea50', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:56:02.139499 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:02.140147 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:02.146609 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:02.147096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:02.148562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:02.148562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:02.148824 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:02.149170 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:02.181045 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:02.181535 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:02.181973 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:02.182456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lazy-loading 'fault' on Instance uuid 40c9cb84-5a6e-46f5-a67a-ba8cc838829a {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:56:02.229840 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:02.238541 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b111b9d0-1fcf-4370-b35e-2ba003e3486b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 200 len: 1332 microversion: 2.1 time: 0.103585 Aug 22 12:56:02.239116 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 407/812] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:02 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:56:02.515068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:56:02.516019 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:56:02.516491 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:56:02.516898 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:56:02.517307 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:56:02.526460 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:02.526990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:02.527367 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:02.528101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:02.528556 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:02.528983 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:02.545970 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Getting quotas for project 2ad064334a6e49719a1162b53a6b7b0e. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:56:02.549944 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Getting quotas for user ee6b61e59be8455bb272c97b040684d4 and project 2ad064334a6e49719a1162b53a6b7b0e. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:56:02.561154 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:56:02.563514 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:56:02.706970 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e1fbaf99-ea38-4ac4-a3c2-ad652edff358 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653287 Aug 22 12:56:02.707531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 406/813] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:56:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:56:02.718198 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7f65641f-329e-4337-96dd-952ee7050767 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:02.719474 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7f65641f-329e-4337-96dd-952ee7050767 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:02.774910 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7f65641f-329e-4337-96dd-952ee7050767 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:02.784817 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7f65641f-329e-4337-96dd-952ee7050767 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1219 microversion: 2.1 time: 0.070300 Aug 22 12:56:02.798242 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 408/814] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:02 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:03.260314 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:03.260932 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:03.269319 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:03.269739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:03.270172 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:03.270892 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:03.271350 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:03.271770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:03.289831 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a HTTP/1.1 Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:56:03.291531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:56:03.293339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '40c9cb84-5a6e-46f5-a67a-ba8cc838829a'} Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:56:03.294480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:56:03.296060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:56:03.298058 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:56:03.298058 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-30e9ec30-b722-4eeb-b6f3-1d6c69908a9b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 404 len: 111 microversion: 2.1 time: 0.037139 Aug 22 12:56:03.298058 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 407/815] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:03 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:56:03.302723 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0e580d9e-05a3-411f-b6da-f5081b4ff9a1 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '.version_select at 0x7f7659c4f160>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:03.363604 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0e580d9e-05a3-411f-b6da-f5081b4ff9a1 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555673048" status: 202 len: 0 microversion: 2.1 time: 0.064589 Aug 22 12:56:03.364242 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 409/816] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 22 12:56:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555673048 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:56:03.807912 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-928cb41c-b829-46b6-a70d-9f375eba9e16 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:03.808481 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-928cb41c-b829-46b6-a70d-9f375eba9e16 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:03.815137 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-928cb41c-b829-46b6-a70d-9f375eba9e16 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:03.817280 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-928cb41c-b829-46b6-a70d-9f375eba9e16 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:03.817280 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-928cb41c-b829-46b6-a70d-9f375eba9e16 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:03.817280 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-928cb41c-b829-46b6-a70d-9f375eba9e16 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:03.817280 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-928cb41c-b829-46b6-a70d-9f375eba9e16 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:03.818109 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-928cb41c-b829-46b6-a70d-9f375eba9e16 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:03.880293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-928cb41c-b829-46b6-a70d-9f375eba9e16 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:03.887997 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-928cb41c-b829-46b6-a70d-9f375eba9e16 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1215 microversion: 2.1 time: 0.084132 Aug 22 12:56:03.888678 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 408/817] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:03 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:04.136952 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f0dc5d65-73ad-4a94-83cd-1ee47ee3e130 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:04.137495 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f0dc5d65-73ad-4a94-83cd-1ee47ee3e130 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:04.143753 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0dc5d65-73ad-4a94-83cd-1ee47ee3e130 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:04.144232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0dc5d65-73ad-4a94-83cd-1ee47ee3e130 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:04.144665 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0dc5d65-73ad-4a94-83cd-1ee47ee3e130 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:04.145356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0dc5d65-73ad-4a94-83cd-1ee47ee3e130 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:04.145804 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0dc5d65-73ad-4a94-83cd-1ee47ee3e130 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:04.146246 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f0dc5d65-73ad-4a94-83cd-1ee47ee3e130 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:04.225556 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-f0dc5d65-73ad-4a94-83cd-1ee47ee3e130 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lazy-loading 'services' on Instance uuid 746985f5-95e3-4ad2-a997-67653768dfd3 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:56:04.464734 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f0dc5d65-73ad-4a94-83cd-1ee47ee3e130 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-volume_attachments/adcdcfe7-5eb5-4939-8aab-aace8368fbda" status: 202 len: 0 microversion: 2.1 time: 0.332353 Aug 22 12:56:04.465443 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 410/818] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 12:56:04 2022] DELETE /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-volume_attachments/adcdcfe7-5eb5-4939-8aab-aace8368fbda => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:56:04.475197 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-74293b63-2155-4ebd-8ae9-e91ad08b80e2 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:04.477436 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-74293b63-2155-4ebd-8ae9-e91ad08b80e2 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:04.484084 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74293b63-2155-4ebd-8ae9-e91ad08b80e2 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:04.485165 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74293b63-2155-4ebd-8ae9-e91ad08b80e2 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:04.485688 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74293b63-2155-4ebd-8ae9-e91ad08b80e2 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:04.486420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74293b63-2155-4ebd-8ae9-e91ad08b80e2 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:04.486903 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74293b63-2155-4ebd-8ae9-e91ad08b80e2 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:04.487298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-74293b63-2155-4ebd-8ae9-e91ad08b80e2 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:04.517273 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-74293b63-2155-4ebd-8ae9-e91ad08b80e2 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046179 Aug 22 12:56:04.517824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 409/819] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:56:04 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:56:04.912086 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3643b846-280c-45b4-b3d3-0c70daaf5e22 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:04.912789 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3643b846-280c-45b4-b3d3-0c70daaf5e22 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:04.919166 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3643b846-280c-45b4-b3d3-0c70daaf5e22 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:04.919684 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3643b846-280c-45b4-b3d3-0c70daaf5e22 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:04.920172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3643b846-280c-45b4-b3d3-0c70daaf5e22 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:04.920866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3643b846-280c-45b4-b3d3-0c70daaf5e22 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:04.921333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3643b846-280c-45b4-b3d3-0c70daaf5e22 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:04.921842 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3643b846-280c-45b4-b3d3-0c70daaf5e22 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:04.984772 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3643b846-280c-45b4-b3d3-0c70daaf5e22 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:04.992594 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3643b846-280c-45b4-b3d3-0c70daaf5e22 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1289 microversion: 2.1 time: 0.084794 Aug 22 12:56:04.993177 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 411/820] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:04 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:05.529604 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-83c45dbb-98be-46d7-b124-2152f75a243c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:05.532584 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-83c45dbb-98be-46d7-b124-2152f75a243c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:05.539298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83c45dbb-98be-46d7-b124-2152f75a243c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:05.539800 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83c45dbb-98be-46d7-b124-2152f75a243c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:05.540243 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83c45dbb-98be-46d7-b124-2152f75a243c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:05.541117 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83c45dbb-98be-46d7-b124-2152f75a243c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:05.541477 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83c45dbb-98be-46d7-b124-2152f75a243c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:05.541908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83c45dbb-98be-46d7-b124-2152f75a243c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:05.572062 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-83c45dbb-98be-46d7-b124-2152f75a243c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 Aug 22 12:56:05.572956 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 410/821] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:56:05 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:56:06.012905 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b539a4a6-80a0-47c4-a834-d08e763756a7 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:06.013730 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b539a4a6-80a0-47c4-a834-d08e763756a7 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:06.020231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b539a4a6-80a0-47c4-a834-d08e763756a7 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:06.020726 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b539a4a6-80a0-47c4-a834-d08e763756a7 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:06.021219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b539a4a6-80a0-47c4-a834-d08e763756a7 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:06.021864 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b539a4a6-80a0-47c4-a834-d08e763756a7 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:06.022358 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b539a4a6-80a0-47c4-a834-d08e763756a7 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:06.022791 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b539a4a6-80a0-47c4-a834-d08e763756a7 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:06.175894 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b539a4a6-80a0-47c4-a834-d08e763756a7 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:06.180853 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-28727fec-51ce-43d9-8ed5-a8510c4fb71b req-5c9dc553-6a71-49e1-a767-34e14c93d59e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "427deb13-8317-4c5f-a629-5a04cfc2f120", "tag": "6a8cd0b3-3540-4f16-ae24-240ccb88da90"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:56:06.184328 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b539a4a6-80a0-47c4-a834-d08e763756a7 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1319 microversion: 2.1 time: 0.175196 Aug 22 12:56:06.185219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 412/822] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:06 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:06.198377 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-28727fec-51ce-43d9-8ed5-a8510c4fb71b req-5c9dc553-6a71-49e1-a767-34e14c93d59e service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:06.203840 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-28727fec-51ce-43d9-8ed5-a8510c4fb71b req-5c9dc553-6a71-49e1-a767-34e14c93d59e service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:06.203840 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-28727fec-51ce-43d9-8ed5-a8510c4fb71b req-5c9dc553-6a71-49e1-a767-34e14c93d59e service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:06.211490 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-28727fec-51ce-43d9-8ed5-a8510c4fb71b req-5c9dc553-6a71-49e1-a767-34e14c93d59e service nova] Creating event network-changed:6a8cd0b3-3540-4f16-ae24-240ccb88da90 for instance 427deb13-8317-4c5f-a629-5a04cfc2f120 on hv-cinder-85083 Aug 22 12:56:06.216894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-28727fec-51ce-43d9-8ed5-a8510c4fb71b req-5c9dc553-6a71-49e1-a767-34e14c93d59e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044138 Aug 22 12:56:06.221020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 411/823] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:56:06.584659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-27560d30-f668-4faf-846f-1cd5cc7d0d4c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:06.587179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-27560d30-f668-4faf-846f-1cd5cc7d0d4c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:06.592979 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-27560d30-f668-4faf-846f-1cd5cc7d0d4c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:06.593463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-27560d30-f668-4faf-846f-1cd5cc7d0d4c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:06.594579 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-27560d30-f668-4faf-846f-1cd5cc7d0d4c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:06.595285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-27560d30-f668-4faf-846f-1cd5cc7d0d4c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:06.595737 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-27560d30-f668-4faf-846f-1cd5cc7d0d4c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:06.596158 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-27560d30-f668-4faf-846f-1cd5cc7d0d4c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:06.624831 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-27560d30-f668-4faf-846f-1cd5cc7d0d4c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044258 Aug 22 12:56:06.625905 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 413/824] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:56:06 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 12:56:06.687351 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e0485114-be8b-4118-8655-f6bcf80de3be tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:06.688448 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e0485114-be8b-4118-8655-f6bcf80de3be tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:06.695024 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0485114-be8b-4118-8655-f6bcf80de3be tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:06.695521 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0485114-be8b-4118-8655-f6bcf80de3be tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:06.696222 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0485114-be8b-4118-8655-f6bcf80de3be tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:06.696763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0485114-be8b-4118-8655-f6bcf80de3be tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:06.697226 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0485114-be8b-4118-8655-f6bcf80de3be tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:06.697661 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0485114-be8b-4118-8655-f6bcf80de3be tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:06.722831 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e0485114-be8b-4118-8655-f6bcf80de3be tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:56:07.086335 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e0485114-be8b-4118-8655-f6bcf80de3be tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 204 len: 0 microversion: 2.1 time: 0.393678 Aug 22 12:56:07.086335 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 412/825] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:56:06 2022] DELETE /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 12:56:07.086633 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c50bb508-7bab-43ae-a1b0-2adb2813d084 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:07.087094 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c50bb508-7bab-43ae-a1b0-2adb2813d084 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:07.094921 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c50bb508-7bab-43ae-a1b0-2adb2813d084 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:07.095424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c50bb508-7bab-43ae-a1b0-2adb2813d084 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:07.095872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c50bb508-7bab-43ae-a1b0-2adb2813d084 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:07.096588 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c50bb508-7bab-43ae-a1b0-2adb2813d084 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:07.097107 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c50bb508-7bab-43ae-a1b0-2adb2813d084 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:07.097543 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c50bb508-7bab-43ae-a1b0-2adb2813d084 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:07.211288 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-02b0f443-c8ad-4834-9f7f-c9c911d91489 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:07.212095 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-02b0f443-c8ad-4834-9f7f-c9c911d91489 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:07.217944 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02b0f443-c8ad-4834-9f7f-c9c911d91489 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:07.218478 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02b0f443-c8ad-4834-9f7f-c9c911d91489 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:07.218983 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02b0f443-c8ad-4834-9f7f-c9c911d91489 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:07.219674 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02b0f443-c8ad-4834-9f7f-c9c911d91489 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:07.220130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02b0f443-c8ad-4834-9f7f-c9c911d91489 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:07.220556 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-02b0f443-c8ad-4834-9f7f-c9c911d91489 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:07.226295 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c50bb508-7bab-43ae-a1b0-2adb2813d084 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:07.234175 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c50bb508-7bab-43ae-a1b0-2adb2813d084 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1680 microversion: 2.1 time: 0.151831 Aug 22 12:56:07.235288 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 414/826] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:07 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:07.350670 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-02b0f443-c8ad-4834-9f7f-c9c911d91489 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:07.358531 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-02b0f443-c8ad-4834-9f7f-c9c911d91489 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1319 microversion: 2.1 time: 0.151415 Aug 22 12:56:07.359095 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 413/827] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:07 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:56:08.257442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3f0a03cb-bfa5-4a8e-a08e-a1957f0ddecf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:08.258056 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3f0a03cb-bfa5-4a8e-a08e-a1957f0ddecf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:08.264577 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f0a03cb-bfa5-4a8e-a08e-a1957f0ddecf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:08.265075 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f0a03cb-bfa5-4a8e-a08e-a1957f0ddecf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:08.265589 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f0a03cb-bfa5-4a8e-a08e-a1957f0ddecf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:08.266943 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f0a03cb-bfa5-4a8e-a08e-a1957f0ddecf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:08.267408 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f0a03cb-bfa5-4a8e-a08e-a1957f0ddecf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:08.267841 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f0a03cb-bfa5-4a8e-a08e-a1957f0ddecf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:08.270566 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:08.379185 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8acc51cf-eadb-4d06-ab43-770a72f3ab6c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:08.387936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8acc51cf-eadb-4d06-ab43-770a72f3ab6c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:08.387936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8acc51cf-eadb-4d06-ab43-770a72f3ab6c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:08.387936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8acc51cf-eadb-4d06-ab43-770a72f3ab6c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:08.387936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8acc51cf-eadb-4d06-ab43-770a72f3ab6c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:08.388496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8acc51cf-eadb-4d06-ab43-770a72f3ab6c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:08.388496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8acc51cf-eadb-4d06-ab43-770a72f3ab6c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:08.388684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8acc51cf-eadb-4d06-ab43-770a72f3ab6c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:08.401612 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3f0a03cb-bfa5-4a8e-a08e-a1957f0ddecf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:08.409511 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3f0a03cb-bfa5-4a8e-a08e-a1957f0ddecf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1680 microversion: 2.1 time: 0.156097 Aug 22 12:56:08.410723 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 415/828] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:08 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:08.523083 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8acc51cf-eadb-4d06-ab43-770a72f3ab6c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:08.526673 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:08.531387 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8acc51cf-eadb-4d06-ab43-770a72f3ab6c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1319 microversion: 2.1 time: 0.156505 Aug 22 12:56:08.531950 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 414/829] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:08 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:56:09.430983 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3ab20e1b-a6a1-40c7-8950-e8063bc09fa7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:09.431534 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3ab20e1b-a6a1-40c7-8950-e8063bc09fa7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:09.437892 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3ab20e1b-a6a1-40c7-8950-e8063bc09fa7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:09.438435 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3ab20e1b-a6a1-40c7-8950-e8063bc09fa7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:09.438881 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3ab20e1b-a6a1-40c7-8950-e8063bc09fa7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:09.439576 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3ab20e1b-a6a1-40c7-8950-e8063bc09fa7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:09.440672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3ab20e1b-a6a1-40c7-8950-e8063bc09fa7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:09.441196 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3ab20e1b-a6a1-40c7-8950-e8063bc09fa7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:09.552468 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9200998f-63c7-4634-a233-7b066e994055 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:09.553091 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9200998f-63c7-4634-a233-7b066e994055 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:09.560025 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9200998f-63c7-4634-a233-7b066e994055 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:09.560584 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9200998f-63c7-4634-a233-7b066e994055 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:09.561918 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9200998f-63c7-4634-a233-7b066e994055 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:09.561918 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9200998f-63c7-4634-a233-7b066e994055 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:09.562285 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9200998f-63c7-4634-a233-7b066e994055 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:09.562718 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9200998f-63c7-4634-a233-7b066e994055 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:09.572202 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3ab20e1b-a6a1-40c7-8950-e8063bc09fa7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:09.580451 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3ab20e1b-a6a1-40c7-8950-e8063bc09fa7 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1680 microversion: 2.1 time: 0.153398 Aug 22 12:56:09.581025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 416/830] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:09 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:09.692652 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-9200998f-63c7-4634-a233-7b066e994055 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:09.700062 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9200998f-63c7-4634-a233-7b066e994055 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1319 microversion: 2.1 time: 0.151953 Aug 22 12:56:09.700618 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 415/831] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:09 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:56:10.602581 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-af8d9ea0-8761-4b93-a6ff-3807b544f81c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:10.603227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-af8d9ea0-8761-4b93-a6ff-3807b544f81c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:10.609797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-af8d9ea0-8761-4b93-a6ff-3807b544f81c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:10.610919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-af8d9ea0-8761-4b93-a6ff-3807b544f81c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:10.611356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-af8d9ea0-8761-4b93-a6ff-3807b544f81c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:10.612047 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-af8d9ea0-8761-4b93-a6ff-3807b544f81c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:10.612500 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-af8d9ea0-8761-4b93-a6ff-3807b544f81c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:10.612924 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-af8d9ea0-8761-4b93-a6ff-3807b544f81c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:10.675427 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-af8d9ea0-8761-4b93-a6ff-3807b544f81c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:10.683412 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-af8d9ea0-8761-4b93-a6ff-3807b544f81c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1613 microversion: 2.1 time: 0.084730 Aug 22 12:56:10.684501 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 417/832] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:10 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:10.721363 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9ccae834-f6a2-45a8-80d7-029250e9f7ef tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:10.721987 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9ccae834-f6a2-45a8-80d7-029250e9f7ef tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:10.728799 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ccae834-f6a2-45a8-80d7-029250e9f7ef tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:10.729296 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ccae834-f6a2-45a8-80d7-029250e9f7ef tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:10.729996 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ccae834-f6a2-45a8-80d7-029250e9f7ef tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:10.730733 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ccae834-f6a2-45a8-80d7-029250e9f7ef tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:10.731610 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ccae834-f6a2-45a8-80d7-029250e9f7ef tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:10.731988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9ccae834-f6a2-45a8-80d7-029250e9f7ef tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:10.738278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-20ba9d93-d14d-4d4e-91b0-0a1997c84281 req-3bd1a58d-8053-4b73-b28e-e88126d48911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746985f5-95e3-4ad2-a997-67653768dfd3", "name": "network-vif-deleted", "tag": "21b63d76-4db0-4418-9307-fd5e2193ad9d"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:56:10.745912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-20ba9d93-d14d-4d4e-91b0-0a1997c84281 req-3bd1a58d-8053-4b73-b28e-e88126d48911 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:10.751680 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-20ba9d93-d14d-4d4e-91b0-0a1997c84281 req-3bd1a58d-8053-4b73-b28e-e88126d48911 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:10.751680 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-20ba9d93-d14d-4d4e-91b0-0a1997c84281 req-3bd1a58d-8053-4b73-b28e-e88126d48911 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:10.758067 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-20ba9d93-d14d-4d4e-91b0-0a1997c84281 req-3bd1a58d-8053-4b73-b28e-e88126d48911 service nova] Creating event network-vif-deleted:21b63d76-4db0-4418-9307-fd5e2193ad9d for instance 746985f5-95e3-4ad2-a997-67653768dfd3 on hv-cinder-85083 Aug 22 12:56:10.762998 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-20ba9d93-d14d-4d4e-91b0-0a1997c84281 req-3bd1a58d-8053-4b73-b28e-e88126d48911 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030639 Aug 22 12:56:10.763595 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 418/833] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:56:10.901442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-9ccae834-f6a2-45a8-80d7-029250e9f7ef tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:10.910588 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9ccae834-f6a2-45a8-80d7-029250e9f7ef tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1319 microversion: 2.1 time: 0.193483 Aug 22 12:56:10.911178 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 416/834] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:10 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:11.706051 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:11.709101 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:11.713134 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:11.713630 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:11.714071 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:11.714800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:11.715259 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:11.715688 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:11.748730 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:11.749194 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:11.749631 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:11.750082 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lazy-loading 'fault' on Instance uuid 746985f5-95e3-4ad2-a997-67653768dfd3 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:56:11.796389 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:11.809419 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-25d8ebc1-2547-40bf-b0fc-5547ca32f48f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 200 len: 1332 microversion: 2.1 time: 0.107994 Aug 22 12:56:11.810436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 419/835] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:11 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:11.931141 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-aecff2a1-a098-4606-8092-93b81f55599d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:11.932084 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-aecff2a1-a098-4606-8092-93b81f55599d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:11.941772 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aecff2a1-a098-4606-8092-93b81f55599d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:11.941772 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aecff2a1-a098-4606-8092-93b81f55599d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:11.941772 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aecff2a1-a098-4606-8092-93b81f55599d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:11.941772 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aecff2a1-a098-4606-8092-93b81f55599d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:11.942139 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aecff2a1-a098-4606-8092-93b81f55599d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:11.942139 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aecff2a1-a098-4606-8092-93b81f55599d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:12.073207 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-aecff2a1-a098-4606-8092-93b81f55599d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:12.080796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-aecff2a1-a098-4606-8092-93b81f55599d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1319 microversion: 2.1 time: 0.153512 Aug 22 12:56:12.081657 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 417/836] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:11 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:12.832352 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:12.832869 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:12.835351 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:12.840103 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:12.840609 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:12.841028 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:12.841717 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:12.842209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:12.851175 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:12.855786 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 HTTP/1.1 Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:56:12.857426 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:56:12.858981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '746985f5-95e3-4ad2-a997-67653768dfd3'} Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:56:12.859859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:56:12.861356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:56:12.862711 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:56:12.862711 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-045dbb05-4e79-4e66-a7e2-9c703d859a3f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 404 len: 111 microversion: 2.1 time: 0.031136 Aug 22 12:56:12.862711 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 420/837] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:12 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:56:12.867445 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7330bffb-129c-4f25-b947-f17772bc9080 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '.version_select at 0x7f7659c6d040>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:12.874533 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:12.875915 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=6 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:12.945943 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7330bffb-129c-4f25-b947-f17772bc9080 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535659742" status: 202 len: 0 microversion: 2.1 time: 0.082215 Aug 22 12:56:12.946595 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 418/838] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 22 12:56:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535659742 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:56:13.101641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c269c682-5432-49ff-8b94-34e475d1cb65 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:13.102214 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c269c682-5432-49ff-8b94-34e475d1cb65 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:13.108808 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c269c682-5432-49ff-8b94-34e475d1cb65 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:13.109302 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c269c682-5432-49ff-8b94-34e475d1cb65 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:13.110254 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c269c682-5432-49ff-8b94-34e475d1cb65 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:13.110952 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c269c682-5432-49ff-8b94-34e475d1cb65 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:13.111404 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c269c682-5432-49ff-8b94-34e475d1cb65 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:13.111834 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c269c682-5432-49ff-8b94-34e475d1cb65 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:13.251587 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c269c682-5432-49ff-8b94-34e475d1cb65 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:13.259247 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c269c682-5432-49ff-8b94-34e475d1cb65 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1319 microversion: 2.1 time: 0.161567 Aug 22 12:56:13.259810 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 421/839] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:13 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:13.668930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dfa97f28-05f9-4bbb-a9ef-cf2c509d65aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: .version_select at 0x7f7659cc2670>, body: {"keypair": {"name": "tempest-keypair-1014103216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoavlKbu5fZbXU8MGj4LtB9w/NuWQnQRm0gXKk6GM8gVj6cWWD/U3EmR60F6vCvkplYs+sEbFaHAJTF0frYK+S87bRnrhjc69kOmusFTaglNw3MdTOTLiWhdZMBj76/kg=="}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:56:13.685951 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-dfa97f28-05f9-4bbb-a9ef-cf2c509d65aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:56:13.689814 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-dfa97f28-05f9-4bbb-a9ef-cf2c509d65aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for user 74e80391b8814b44b13a6b38d36b15ee and project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:56:13.838737 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-dfa97f28-05f9-4bbb-a9ef-cf2c509d65aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174215 Aug 22 12:56:13.839391 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 419/840] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 22 12:56:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:56:14.001859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-60b448ae-befd-4ce5-9fda-e80f2f01626c req-8ef1d9a7-0bbd-4505-b672-5f3b5c888920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427deb13-8317-4c5f-a629-5a04cfc2f120", "name": "network-vif-plugged", "status": "completed", "tag": "6a8cd0b3-3540-4f16-ae24-240ccb88da90"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:56:14.011475 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-60b448ae-befd-4ce5-9fda-e80f2f01626c req-8ef1d9a7-0bbd-4505-b672-5f3b5c888920 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:14.011927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-60b448ae-befd-4ce5-9fda-e80f2f01626c req-8ef1d9a7-0bbd-4505-b672-5f3b5c888920 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:14.012365 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-60b448ae-befd-4ce5-9fda-e80f2f01626c req-8ef1d9a7-0bbd-4505-b672-5f3b5c888920 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:14.023556 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-60b448ae-befd-4ce5-9fda-e80f2f01626c req-8ef1d9a7-0bbd-4505-b672-5f3b5c888920 service nova] Creating event network-vif-plugged:6a8cd0b3-3540-4f16-ae24-240ccb88da90 for instance 427deb13-8317-4c5f-a629-5a04cfc2f120 on hv-cinder-85083 Aug 22 12:56:14.028193 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-60b448ae-befd-4ce5-9fda-e80f2f01626c req-8ef1d9a7-0bbd-4505-b672-5f3b5c888920 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030060 Aug 22 12:56:14.028840 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 422/841] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:56:14.281372 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-24d1185b-b3d8-4648-bdb4-d8f81bcc80ff tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:14.282057 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-24d1185b-b3d8-4648-bdb4-d8f81bcc80ff tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:14.288081 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-24d1185b-b3d8-4648-bdb4-d8f81bcc80ff tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:14.289349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-24d1185b-b3d8-4648-bdb4-d8f81bcc80ff tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:14.289349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-24d1185b-b3d8-4648-bdb4-d8f81bcc80ff tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:14.290076 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-24d1185b-b3d8-4648-bdb4-d8f81bcc80ff tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:14.290313 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-24d1185b-b3d8-4648-bdb4-d8f81bcc80ff tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:14.290755 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-24d1185b-b3d8-4648-bdb4-d8f81bcc80ff tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:14.421232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-24d1185b-b3d8-4648-bdb4-d8f81bcc80ff tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:14.428983 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-24d1185b-b3d8-4648-bdb4-d8f81bcc80ff tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1319 microversion: 2.1 time: 0.152155 Aug 22 12:56:14.429563 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 420/842] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:14 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:56:15.451387 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d8018ef5-dbe8-458b-9aea-1af1f701c3f6 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:15.452083 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d8018ef5-dbe8-458b-9aea-1af1f701c3f6 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:15.458736 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d8018ef5-dbe8-458b-9aea-1af1f701c3f6 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:15.459224 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d8018ef5-dbe8-458b-9aea-1af1f701c3f6 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:15.459665 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d8018ef5-dbe8-458b-9aea-1af1f701c3f6 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:15.460357 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d8018ef5-dbe8-458b-9aea-1af1f701c3f6 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:15.460810 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d8018ef5-dbe8-458b-9aea-1af1f701c3f6 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:15.461255 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d8018ef5-dbe8-458b-9aea-1af1f701c3f6 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:15.597357 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d8018ef5-dbe8-458b-9aea-1af1f701c3f6 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:15.603073 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d8018ef5-dbe8-458b-9aea-1af1f701c3f6 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1319 microversion: 2.1 time: 0.156345 Aug 22 12:56:15.603715 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 423/843] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:15 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:15.944293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2081508220", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45d598ec-3137-4425-8c25-3a2a4913d98a"}], "security_groups": [{"name": "tempest-securitygroup--1252719675"}], "key_name": "tempest-keypair-1014103216", "user_data": "}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:56:16.043893 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] validate_networks() for [('45d598ec-3137-4425-8c25-3a2a4913d98a', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:56:16.623686 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2fa1086f-bd70-4cb3-9bae-424d86e166c3 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:16.624429 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2fa1086f-bd70-4cb3-9bae-424d86e166c3 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:16.630622 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fa1086f-bd70-4cb3-9bae-424d86e166c3 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:16.631117 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fa1086f-bd70-4cb3-9bae-424d86e166c3 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:16.631557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fa1086f-bd70-4cb3-9bae-424d86e166c3 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:16.632259 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fa1086f-bd70-4cb3-9bae-424d86e166c3 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:16.632722 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fa1086f-bd70-4cb3-9bae-424d86e166c3 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:16.633148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2fa1086f-bd70-4cb3-9bae-424d86e166c3 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:16.643575 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:56:16.643999 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:56:16.644468 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:56:16.644881 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:56:16.645291 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:56:16.653910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:16.654484 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:16.654871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:16.655667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:16.656127 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:16.657207 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:16.674244 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:56:16.678288 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for user 74e80391b8814b44b13a6b38d36b15ee and project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:56:16.689167 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:56:16.691494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:56:16.764465 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2fa1086f-bd70-4cb3-9bae-424d86e166c3 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:16.773168 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2fa1086f-bd70-4cb3-9bae-424d86e166c3 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1508 microversion: 2.1 time: 0.152895 Aug 22 12:56:16.773291 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 424/844] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:16 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:16.796732 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1a9b17cc-ee9d-4276-b03e-d2d4bcf73879 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05fda4bc-a61d-45d1-b0cf-9dbb632aa197", "device": "/dev/sdb"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:56:16.798602 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1ed90e75-059a-452d-bb56-ca56ce9e201c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.858599 Aug 22 12:56:16.799406 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 421/845] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:56:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:56:16.799773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1a9b17cc-ee9d-4276-b03e-d2d4bcf73879 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:16.805980 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a9b17cc-ee9d-4276-b03e-d2d4bcf73879 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:16.806505 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a9b17cc-ee9d-4276-b03e-d2d4bcf73879 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:16.807329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a9b17cc-ee9d-4276-b03e-d2d4bcf73879 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:16.807679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a9b17cc-ee9d-4276-b03e-d2d4bcf73879 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:16.808127 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a9b17cc-ee9d-4276-b03e-d2d4bcf73879 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:16.808560 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a9b17cc-ee9d-4276-b03e-d2d4bcf73879 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:16.809675 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-96fe38ad-fcd6-41bd-9842-79de6caef551 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:16.810313 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-96fe38ad-fcd6-41bd-9842-79de6caef551 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:16.813536 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:16.869748 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-96fe38ad-fcd6-41bd-9842-79de6caef551 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:16.877088 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-96fe38ad-fcd6-41bd-9842-79de6caef551 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1242 microversion: 2.1 time: 0.070947 Aug 22 12:56:16.877863 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 422/846] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:16 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:56:17.509311 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1a9b17cc-ee9d-4276-b03e-d2d4bcf73879 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "POST /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.716201 Aug 22 12:56:17.509926 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 425/847] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:56:16 2022] POST /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:56:17.897007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ecdd9fff-d3a2-4af0-a739-98445c36d943 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:17.897724 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ecdd9fff-d3a2-4af0-a739-98445c36d943 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:17.904829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ecdd9fff-d3a2-4af0-a739-98445c36d943 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:17.905314 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ecdd9fff-d3a2-4af0-a739-98445c36d943 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:17.905776 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ecdd9fff-d3a2-4af0-a739-98445c36d943 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:17.907002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ecdd9fff-d3a2-4af0-a739-98445c36d943 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:17.907466 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ecdd9fff-d3a2-4af0-a739-98445c36d943 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:17.907895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ecdd9fff-d3a2-4af0-a739-98445c36d943 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:17.967701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ecdd9fff-d3a2-4af0-a739-98445c36d943 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:17.975887 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ecdd9fff-d3a2-4af0-a739-98445c36d943 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1246 microversion: 2.1 time: 0.082699 Aug 22 12:56:17.976459 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 423/848] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:17 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:18.997964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-274f1168-14f5-4155-89db-9114b7902e5b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:18.998691 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-274f1168-14f5-4155-89db-9114b7902e5b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:19.001238 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:19.006118 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274f1168-14f5-4155-89db-9114b7902e5b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:19.006658 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274f1168-14f5-4155-89db-9114b7902e5b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:19.007096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274f1168-14f5-4155-89db-9114b7902e5b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:19.007828 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274f1168-14f5-4155-89db-9114b7902e5b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:19.008289 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274f1168-14f5-4155-89db-9114b7902e5b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:19.008715 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-274f1168-14f5-4155-89db-9114b7902e5b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:19.087890 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-274f1168-14f5-4155-89db-9114b7902e5b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:19.087890 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-274f1168-14f5-4155-89db-9114b7902e5b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1302 microversion: 2.1 time: 0.094469 Aug 22 12:56:19.088442 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 426/849] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:18 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:20.108119 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-67fccf0a-47fa-40e1-86ec-0a565c7331d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:20.108729 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-67fccf0a-47fa-40e1-86ec-0a565c7331d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:20.114708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67fccf0a-47fa-40e1-86ec-0a565c7331d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:20.115189 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67fccf0a-47fa-40e1-86ec-0a565c7331d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:20.115621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67fccf0a-47fa-40e1-86ec-0a565c7331d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:20.116315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67fccf0a-47fa-40e1-86ec-0a565c7331d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:20.117103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67fccf0a-47fa-40e1-86ec-0a565c7331d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:20.117309 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67fccf0a-47fa-40e1-86ec-0a565c7331d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:20.257229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-67fccf0a-47fa-40e1-86ec-0a565c7331d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:20.265560 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-67fccf0a-47fa-40e1-86ec-0a565c7331d3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1368 microversion: 2.1 time: 0.161524 Aug 22 12:56:20.270209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 424/850] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:20 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:20.489260 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-21cfdda7-f148-4a6c-9631-1f879259d0f8 req-fab0a2c1-7c97-4d4e-ad41-3f7e32a71d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "165802c8-5150-48e3-9add-861d2ffd9c00", "tag": "e8a32dc3-2017-4c97-b29a-40f4fe57374b"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:56:20.499684 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-21cfdda7-f148-4a6c-9631-1f879259d0f8 req-fab0a2c1-7c97-4d4e-ad41-3f7e32a71d0e service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:20.500161 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-21cfdda7-f148-4a6c-9631-1f879259d0f8 req-fab0a2c1-7c97-4d4e-ad41-3f7e32a71d0e service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:20.501250 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-21cfdda7-f148-4a6c-9631-1f879259d0f8 req-fab0a2c1-7c97-4d4e-ad41-3f7e32a71d0e service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:20.511896 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-21cfdda7-f148-4a6c-9631-1f879259d0f8 req-fab0a2c1-7c97-4d4e-ad41-3f7e32a71d0e service nova] Creating event network-changed:e8a32dc3-2017-4c97-b29a-40f4fe57374b for instance 165802c8-5150-48e3-9add-861d2ffd9c00 on hv-cinder-85083 Aug 22 12:56:20.516645 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-21cfdda7-f148-4a6c-9631-1f879259d0f8 req-fab0a2c1-7c97-4d4e-ad41-3f7e32a71d0e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032754 Aug 22 12:56:20.517394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 427/851] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:56:21.287010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c2da3ff2-f92c-4843-954b-8abdf4bee36d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:21.287576 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c2da3ff2-f92c-4843-954b-8abdf4bee36d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:21.294590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c2da3ff2-f92c-4843-954b-8abdf4bee36d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:21.295089 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c2da3ff2-f92c-4843-954b-8abdf4bee36d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:21.295532 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c2da3ff2-f92c-4843-954b-8abdf4bee36d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:21.296245 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c2da3ff2-f92c-4843-954b-8abdf4bee36d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:21.296713 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c2da3ff2-f92c-4843-954b-8abdf4bee36d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:21.297142 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c2da3ff2-f92c-4843-954b-8abdf4bee36d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:21.425270 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c2da3ff2-f92c-4843-954b-8abdf4bee36d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:21.433069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c2da3ff2-f92c-4843-954b-8abdf4bee36d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1368 microversion: 2.1 time: 0.149981 Aug 22 12:56:21.433643 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 425/852] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:21 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:22.455308 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b5403974-59d9-46d5-b7a9-028f1aba7518 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:22.455992 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b5403974-59d9-46d5-b7a9-028f1aba7518 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:22.462768 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5403974-59d9-46d5-b7a9-028f1aba7518 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:22.463351 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5403974-59d9-46d5-b7a9-028f1aba7518 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:22.463785 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5403974-59d9-46d5-b7a9-028f1aba7518 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:22.464497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5403974-59d9-46d5-b7a9-028f1aba7518 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:22.464948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5403974-59d9-46d5-b7a9-028f1aba7518 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:22.465371 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b5403974-59d9-46d5-b7a9-028f1aba7518 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:22.597908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b5403974-59d9-46d5-b7a9-028f1aba7518 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:22.606312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b5403974-59d9-46d5-b7a9-028f1aba7518 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1368 microversion: 2.1 time: 0.155756 Aug 22 12:56:22.613020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 428/853] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:22 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:23.627585 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-cc621ca9-0a8a-441e-a25a-88cb5bc60495 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:23.628236 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-cc621ca9-0a8a-441e-a25a-88cb5bc60495 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:23.634829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc621ca9-0a8a-441e-a25a-88cb5bc60495 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:23.635319 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc621ca9-0a8a-441e-a25a-88cb5bc60495 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:23.635758 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc621ca9-0a8a-441e-a25a-88cb5bc60495 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:23.636456 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc621ca9-0a8a-441e-a25a-88cb5bc60495 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:23.636914 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc621ca9-0a8a-441e-a25a-88cb5bc60495 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:23.637344 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cc621ca9-0a8a-441e-a25a-88cb5bc60495 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:23.762468 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-cc621ca9-0a8a-441e-a25a-88cb5bc60495 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:23.770070 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-cc621ca9-0a8a-441e-a25a-88cb5bc60495 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1368 microversion: 2.1 time: 0.146940 Aug 22 12:56:23.770669 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 426/854] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:23 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:24.792353 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3847c64b-842c-4e74-873a-e3fe6b1d28f0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:24.792955 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3847c64b-842c-4e74-873a-e3fe6b1d28f0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:24.799773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3847c64b-842c-4e74-873a-e3fe6b1d28f0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:24.800256 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3847c64b-842c-4e74-873a-e3fe6b1d28f0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:24.800686 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3847c64b-842c-4e74-873a-e3fe6b1d28f0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:24.802560 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3847c64b-842c-4e74-873a-e3fe6b1d28f0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:24.803025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3847c64b-842c-4e74-873a-e3fe6b1d28f0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:24.803451 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3847c64b-842c-4e74-873a-e3fe6b1d28f0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:24.943766 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3847c64b-842c-4e74-873a-e3fe6b1d28f0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:24.952118 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3847c64b-842c-4e74-873a-e3fe6b1d28f0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1368 microversion: 2.1 time: 0.165125 Aug 22 12:56:24.952831 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 429/855] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:24 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:25.980748 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9c352d90-ed38-44a6-808c-fd3d8918a623 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:25.981363 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9c352d90-ed38-44a6-808c-fd3d8918a623 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:25.989186 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c352d90-ed38-44a6-808c-fd3d8918a623 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:25.989186 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c352d90-ed38-44a6-808c-fd3d8918a623 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:25.989186 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c352d90-ed38-44a6-808c-fd3d8918a623 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:25.989473 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c352d90-ed38-44a6-808c-fd3d8918a623 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:25.989936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c352d90-ed38-44a6-808c-fd3d8918a623 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:25.990389 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9c352d90-ed38-44a6-808c-fd3d8918a623 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:25.998115 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-1915d73b-e8d1-4f23-82cb-f920dc5d901b req-42229353-9c3c-4b57-87fa-10b5cd38506e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165802c8-5150-48e3-9add-861d2ffd9c00", "name": "network-vif-plugged", "status": "completed", "tag": "e8a32dc3-2017-4c97-b29a-40f4fe57374b"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:56:26.011018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-1915d73b-e8d1-4f23-82cb-f920dc5d901b req-42229353-9c3c-4b57-87fa-10b5cd38506e service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:26.011695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-1915d73b-e8d1-4f23-82cb-f920dc5d901b req-42229353-9c3c-4b57-87fa-10b5cd38506e service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:26.012208 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-1915d73b-e8d1-4f23-82cb-f920dc5d901b req-42229353-9c3c-4b57-87fa-10b5cd38506e service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:26.025713 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-1915d73b-e8d1-4f23-82cb-f920dc5d901b req-42229353-9c3c-4b57-87fa-10b5cd38506e service nova] Creating event network-vif-plugged:e8a32dc3-2017-4c97-b29a-40f4fe57374b for instance 165802c8-5150-48e3-9add-861d2ffd9c00 on hv-cinder-85083 Aug 22 12:56:26.030774 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-1915d73b-e8d1-4f23-82cb-f920dc5d901b req-42229353-9c3c-4b57-87fa-10b5cd38506e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036589 Aug 22 12:56:26.031401 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 430/856] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:56:26.125835 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-9c352d90-ed38-44a6-808c-fd3d8918a623 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:26.134109 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9c352d90-ed38-44a6-808c-fd3d8918a623 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1368 microversion: 2.1 time: 0.157622 Aug 22 12:56:26.134704 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 427/857] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:25 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:56:27.156160 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a38acdf3-e9b9-43ce-91e5-6f2b5b24fb9c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:27.156864 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a38acdf3-e9b9-43ce-91e5-6f2b5b24fb9c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:27.164131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a38acdf3-e9b9-43ce-91e5-6f2b5b24fb9c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:27.165922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a38acdf3-e9b9-43ce-91e5-6f2b5b24fb9c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:27.165922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a38acdf3-e9b9-43ce-91e5-6f2b5b24fb9c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:27.165922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a38acdf3-e9b9-43ce-91e5-6f2b5b24fb9c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:27.166222 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a38acdf3-e9b9-43ce-91e5-6f2b5b24fb9c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:27.166656 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a38acdf3-e9b9-43ce-91e5-6f2b5b24fb9c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:27.296411 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-a38acdf3-e9b9-43ce-91e5-6f2b5b24fb9c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:27.304105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a38acdf3-e9b9-43ce-91e5-6f2b5b24fb9c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1368 microversion: 2.1 time: 0.152133 Aug 22 12:56:27.304665 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 431/858] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:27 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:28.324349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0c15ea59-8841-4da5-98d9-353f352c1499 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:28.324991 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0c15ea59-8841-4da5-98d9-353f352c1499 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:28.326861 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:28.327514 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=12 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:28.332725 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c15ea59-8841-4da5-98d9-353f352c1499 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:28.333201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c15ea59-8841-4da5-98d9-353f352c1499 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:28.333632 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c15ea59-8841-4da5-98d9-353f352c1499 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:28.334353 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c15ea59-8841-4da5-98d9-353f352c1499 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:28.334812 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c15ea59-8841-4da5-98d9-353f352c1499 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:28.337596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c15ea59-8841-4da5-98d9-353f352c1499 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:28.467408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0c15ea59-8841-4da5-98d9-353f352c1499 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:28.475967 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0c15ea59-8841-4da5-98d9-353f352c1499 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1368 microversion: 2.1 time: 0.155436 Aug 22 12:56:28.476528 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 428/859] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:28 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:29.496830 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6eb210dc-b0ec-4de0-9107-656ff9be0371 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:29.497492 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6eb210dc-b0ec-4de0-9107-656ff9be0371 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:29.504440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6eb210dc-b0ec-4de0-9107-656ff9be0371 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:29.504925 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6eb210dc-b0ec-4de0-9107-656ff9be0371 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:29.505357 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6eb210dc-b0ec-4de0-9107-656ff9be0371 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:29.506047 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6eb210dc-b0ec-4de0-9107-656ff9be0371 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:29.506527 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6eb210dc-b0ec-4de0-9107-656ff9be0371 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:29.506940 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6eb210dc-b0ec-4de0-9107-656ff9be0371 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:29.635774 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6eb210dc-b0ec-4de0-9107-656ff9be0371 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:29.644527 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6eb210dc-b0ec-4de0-9107-656ff9be0371 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1368 microversion: 2.1 time: 0.150355 Aug 22 12:56:29.644527 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 432/860] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:29 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:30.664309 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e556ce10-81df-4ee4-88a3-a232ae17f511 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:30.664947 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e556ce10-81df-4ee4-88a3-a232ae17f511 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:30.671334 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e556ce10-81df-4ee4-88a3-a232ae17f511 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:30.671848 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e556ce10-81df-4ee4-88a3-a232ae17f511 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:30.672285 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e556ce10-81df-4ee4-88a3-a232ae17f511 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:30.672975 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e556ce10-81df-4ee4-88a3-a232ae17f511 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:30.674000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e556ce10-81df-4ee4-88a3-a232ae17f511 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:30.674455 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e556ce10-81df-4ee4-88a3-a232ae17f511 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:30.800314 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e556ce10-81df-4ee4-88a3-a232ae17f511 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:30.808877 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e556ce10-81df-4ee4-88a3-a232ae17f511 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1557 microversion: 2.1 time: 0.148415 Aug 22 12:56:30.809438 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 429/861] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:30 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:30.828653 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-63ddc064-4acf-4f9e-8446-39736390f844 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:30.829148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-63ddc064-4acf-4f9e-8446-39736390f844 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:30.835611 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63ddc064-4acf-4f9e-8446-39736390f844 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:30.836098 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63ddc064-4acf-4f9e-8446-39736390f844 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:30.836537 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63ddc064-4acf-4f9e-8446-39736390f844 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:30.837233 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63ddc064-4acf-4f9e-8446-39736390f844 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:30.837693 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63ddc064-4acf-4f9e-8446-39736390f844 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:30.838125 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-63ddc064-4acf-4f9e-8446-39736390f844 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:30.851921 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:30.917523 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-63ddc064-4acf-4f9e-8446-39736390f844 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092712 Aug 22 12:56:30.918124 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 433/862] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 22 12:56:30 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:56:31.961843 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-694e1d27-cccf-4d5a-b9ec-62f19232bef8 req-19967ba1-5a4b-40bb-bce7-9b7bac6b6b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "165802c8-5150-48e3-9add-861d2ffd9c00", "tag": "e8a32dc3-2017-4c97-b29a-40f4fe57374b"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:56:31.972394 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-694e1d27-cccf-4d5a-b9ec-62f19232bef8 req-19967ba1-5a4b-40bb-bce7-9b7bac6b6b93 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:31.972897 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-694e1d27-cccf-4d5a-b9ec-62f19232bef8 req-19967ba1-5a4b-40bb-bce7-9b7bac6b6b93 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:31.973376 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-694e1d27-cccf-4d5a-b9ec-62f19232bef8 req-19967ba1-5a4b-40bb-bce7-9b7bac6b6b93 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:31.989341 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-694e1d27-cccf-4d5a-b9ec-62f19232bef8 req-19967ba1-5a4b-40bb-bce7-9b7bac6b6b93 service nova] Creating event network-changed:e8a32dc3-2017-4c97-b29a-40f4fe57374b for instance 165802c8-5150-48e3-9add-861d2ffd9c00 on hv-cinder-85083 Aug 22 12:56:31.994312 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-694e1d27-cccf-4d5a-b9ec-62f19232bef8 req-19967ba1-5a4b-40bb-bce7-9b7bac6b6b93 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036333 Aug 22 12:56:31.994890 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 430/863] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:56:37.520622 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2a9fc56d-7911-4dbe-94e9-69a8e019b161 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:37.521124 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2a9fc56d-7911-4dbe-94e9-69a8e019b161 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:37.527209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a9fc56d-7911-4dbe-94e9-69a8e019b161 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:37.527717 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a9fc56d-7911-4dbe-94e9-69a8e019b161 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:37.528148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a9fc56d-7911-4dbe-94e9-69a8e019b161 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:37.528822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a9fc56d-7911-4dbe-94e9-69a8e019b161 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:37.529269 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a9fc56d-7911-4dbe-94e9-69a8e019b161 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:37.529686 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a9fc56d-7911-4dbe-94e9-69a8e019b161 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:37.611611 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-2a9fc56d-7911-4dbe-94e9-69a8e019b161 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lazy-loading 'services' on Instance uuid 427deb13-8317-4c5f-a629-5a04cfc2f120 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:56:37.830402 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2a9fc56d-7911-4dbe-94e9-69a8e019b161 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "DELETE /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120/os-volume_attachments/05fda4bc-a61d-45d1-b0cf-9dbb632aa197" status: 202 len: 0 microversion: 2.1 time: 0.313780 Aug 22 12:56:37.830988 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 434/864] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 12:56:37 2022] DELETE /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120/os-volume_attachments/05fda4bc-a61d-45d1-b0cf-9dbb632aa197 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:56:38.947593 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8a0ffbb6-784c-42c3-839a-d7385394c0c5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:38.948185 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8a0ffbb6-784c-42c3-839a-d7385394c0c5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:38.954452 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a0ffbb6-784c-42c3-839a-d7385394c0c5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:38.954945 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a0ffbb6-784c-42c3-839a-d7385394c0c5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:38.955387 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a0ffbb6-784c-42c3-839a-d7385394c0c5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:38.956084 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a0ffbb6-784c-42c3-839a-d7385394c0c5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:38.956555 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a0ffbb6-784c-42c3-839a-d7385394c0c5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:38.956987 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8a0ffbb6-784c-42c3-839a-d7385394c0c5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:38.984150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8a0ffbb6-784c-42c3-839a-d7385394c0c5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:56:39.345706 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8a0ffbb6-784c-42c3-839a-d7385394c0c5 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "DELETE /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 204 len: 0 microversion: 2.1 time: 0.401953 Aug 22 12:56:39.346543 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 431/865] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:56:38 2022] DELETE /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:56:39.355998 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-62a40690-efb5-47ff-abbb-ea3433443be1 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:39.356688 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-62a40690-efb5-47ff-abbb-ea3433443be1 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:39.363058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62a40690-efb5-47ff-abbb-ea3433443be1 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:39.363551 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62a40690-efb5-47ff-abbb-ea3433443be1 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:39.363971 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62a40690-efb5-47ff-abbb-ea3433443be1 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:39.364696 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62a40690-efb5-47ff-abbb-ea3433443be1 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:39.365146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62a40690-efb5-47ff-abbb-ea3433443be1 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:39.365648 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-62a40690-efb5-47ff-abbb-ea3433443be1 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:39.498871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-62a40690-efb5-47ff-abbb-ea3433443be1 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:39.506664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-62a40690-efb5-47ff-abbb-ea3433443be1 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1514 microversion: 2.1 time: 0.155319 Aug 22 12:56:39.507257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 435/866] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:39 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:40.528499 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a17a6d23-0746-429f-9138-b4f1dcb6a0c4 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:40.529197 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a17a6d23-0746-429f-9138-b4f1dcb6a0c4 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:40.536104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a17a6d23-0746-429f-9138-b4f1dcb6a0c4 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:40.536590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a17a6d23-0746-429f-9138-b4f1dcb6a0c4 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:40.537032 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a17a6d23-0746-429f-9138-b4f1dcb6a0c4 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:40.537729 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a17a6d23-0746-429f-9138-b4f1dcb6a0c4 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:40.538204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a17a6d23-0746-429f-9138-b4f1dcb6a0c4 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:40.538687 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a17a6d23-0746-429f-9138-b4f1dcb6a0c4 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:40.542596 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:40.666696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a17a6d23-0746-429f-9138-b4f1dcb6a0c4 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:40.674904 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a17a6d23-0746-429f-9138-b4f1dcb6a0c4 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1514 microversion: 2.1 time: 0.150605 Aug 22 12:56:40.675435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 432/867] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:40 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:56:41.696850 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b1953e3f-5bec-470d-9d6a-88f271d7be7c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:41.697457 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b1953e3f-5bec-470d-9d6a-88f271d7be7c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:41.704018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b1953e3f-5bec-470d-9d6a-88f271d7be7c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:41.704512 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b1953e3f-5bec-470d-9d6a-88f271d7be7c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:41.704953 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b1953e3f-5bec-470d-9d6a-88f271d7be7c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:41.705654 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b1953e3f-5bec-470d-9d6a-88f271d7be7c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:41.706109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b1953e3f-5bec-470d-9d6a-88f271d7be7c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:41.706560 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b1953e3f-5bec-470d-9d6a-88f271d7be7c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:41.833803 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b1953e3f-5bec-470d-9d6a-88f271d7be7c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:41.843880 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b1953e3f-5bec-470d-9d6a-88f271d7be7c tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1514 microversion: 2.1 time: 0.150841 Aug 22 12:56:41.844466 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 436/868] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:41 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:41.994453 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-3d7b8e2c-a6c0-4af4-84f4-48689eb65870 req-710107fb-2fff-4d3a-93bf-e847314efae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427deb13-8317-4c5f-a629-5a04cfc2f120", "name": "network-vif-deleted", "tag": "6a8cd0b3-3540-4f16-ae24-240ccb88da90"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:56:42.004394 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-3d7b8e2c-a6c0-4af4-84f4-48689eb65870 req-710107fb-2fff-4d3a-93bf-e847314efae5 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:42.004876 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-3d7b8e2c-a6c0-4af4-84f4-48689eb65870 req-710107fb-2fff-4d3a-93bf-e847314efae5 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:42.005364 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-3d7b8e2c-a6c0-4af4-84f4-48689eb65870 req-710107fb-2fff-4d3a-93bf-e847314efae5 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:42.016185 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-3d7b8e2c-a6c0-4af4-84f4-48689eb65870 req-710107fb-2fff-4d3a-93bf-e847314efae5 service nova] Creating event network-vif-deleted:6a8cd0b3-3540-4f16-ae24-240ccb88da90 for instance 427deb13-8317-4c5f-a629-5a04cfc2f120 on hv-cinder-85083 Aug 22 12:56:42.021283 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-3d7b8e2c-a6c0-4af4-84f4-48689eb65870 req-710107fb-2fff-4d3a-93bf-e847314efae5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030515 Aug 22 12:56:42.021922 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 433/869] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:56:42.865584 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:42.866204 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:42.872815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:42.873299 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:42.873730 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:42.874569 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:42.874949 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:42.875372 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:42.906312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:42.906785 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:42.907214 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:42.907653 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lazy-loading 'fault' on Instance uuid 427deb13-8317-4c5f-a629-5a04cfc2f120 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:56:42.951429 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6b61e59be8455bb272c97b040684d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad064334a6e49719a1162b53a6b7b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:56:42.959286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-599b3cb5-bfc9-45bd-accf-efdadfce3063 tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 200 len: 1309 microversion: 2.1 time: 0.097618 Aug 22 12:56:42.959835 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 437/870] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:42 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:56:43.979664 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:56:43.980611 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] [instance: 427deb13-8317-4c5f-a629-5a04cfc2f120] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:56:43.987615 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:43.988096 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:43.988553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:43.989235 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:56:43.989687 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:56:43.990107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:56:44.003293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] HTTP exception thrown: Instance 427deb13-8317-4c5f-a629-5a04cfc2f120 could not be found. Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Request method failure captured: Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 HTTP/1.1 Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3yPyoFLyTLJJt0T4mta8OumawdaZ8v__XKkc9aFtct3FhH3n4ubZe7Zhbo1qjDDxOuYT1X_BnSpzxzC2DKvkg0W0aZCAlQj0u6LpPECpUbpOxTg3FdsyISaIGCPOwErZqNSbianaVxrfG57FuaNNOnWv-QE23abzoHbV6--PI3pAD4 Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 2ad064334a6e49719a1162b53a6b7b0e Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-VolumesSnapshotTestJSON-67694960 Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:56:44.005010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2ad064334a6e49719a1162b53a6b7b0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2ad064334a6e49719a1162b53a6b7b0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2ad064334a6e49719a1162b53a6b7b0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2ad064334a6e49719a1162b53a6b7b0e"}]}] Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-VolumesSnapshotTestJSON-67694960 Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 2ad064334a6e49719a1162b53a6b7b0e Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-67694960 Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-VolumesSnapshotTestJSON-67694960-project Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: ee6b61e59be8455bb272c97b040684d4 Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-VolumesSnapshotTestJSON-67694960-project Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 427deb13-8317-4c5f-a629-5a04cfc2f120 could not be found. Aug 22 12:56:44.006789 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '427deb13-8317-4c5f-a629-5a04cfc2f120'} Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 427deb13-8317-4c5f-a629-5a04cfc2f120 could not be found. Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:56:44.007621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 427deb13-8317-4c5f-a629-5a04cfc2f120 could not be found. Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 427deb13-8317-4c5f-a629-5a04cfc2f120 could not be found. Aug 22 12:56:44.008948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:56:44.010119 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] Returning 404 to user: Instance 427deb13-8317-4c5f-a629-5a04cfc2f120 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:56:44.010119 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6405a1ae-9333-40e7-8be5-d2953b54cf0d tempest-VolumesSnapshotTestJSON-67694960 tempest-VolumesSnapshotTestJSON-67694960-project] 10.222.0.15 "GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120" status: 404 len: 111 microversion: 2.1 time: 0.030948 Aug 22 12:56:44.010119 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 434/871] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:56:43 2022] GET /compute/v2.1/servers/427deb13-8317-4c5f-a629-5a04cfc2f120 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:57:08.077871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d588388f-b720-4376-9d6d-d7cf8c6c7532 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:08.078436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d588388f-b720-4376-9d6d-d7cf8c6c7532 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:08.080504 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=25 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:08.081179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:08.085784 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d588388f-b720-4376-9d6d-d7cf8c6c7532 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:08.086305 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d588388f-b720-4376-9d6d-d7cf8c6c7532 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:08.086747 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d588388f-b720-4376-9d6d-d7cf8c6c7532 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:08.087439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d588388f-b720-4376-9d6d-d7cf8c6c7532 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:08.087895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d588388f-b720-4376-9d6d-d7cf8c6c7532 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:08.088322 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d588388f-b720-4376-9d6d-d7cf8c6c7532 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:08.111136 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d588388f-b720-4376-9d6d-d7cf8c6c7532 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/ips" status: 200 len: 149 microversion: 2.1 time: 0.037949 Aug 22 12:57:08.111699 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 438/872] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 22 12:57:08 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:09.734864 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-23ba5ba0-219c-471c-a318-ba48227b5458 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29b8faf3-947f-4f0b-90e7-7a66a040f993"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:09.737169 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-23ba5ba0-219c-471c-a318-ba48227b5458 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:09.739441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:09.740093 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=9 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:09.744792 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ba5ba0-219c-471c-a318-ba48227b5458 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:09.745279 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ba5ba0-219c-471c-a318-ba48227b5458 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:09.745720 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ba5ba0-219c-471c-a318-ba48227b5458 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:09.746506 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ba5ba0-219c-471c-a318-ba48227b5458 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:09.746963 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ba5ba0-219c-471c-a318-ba48227b5458 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:09.747438 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-23ba5ba0-219c-471c-a318-ba48227b5458 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:10.680109 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-23ba5ba0-219c-471c-a318-ba48227b5458 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.949863 Aug 22 12:57:10.680780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 435/873] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:57:09 2022] POST /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments => generated 194 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:18.242025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29b8faf3-947f-4f0b-90e7-7a66a040f993"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:18.244542 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:18.253559 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:18.254398 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:18.254848 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:18.255570 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:18.256105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:18.256551 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:18.575097 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Invalid volume: volume 29b8faf3-947f-4f0b-90e7-7a66a040f993 is already attached to instances: 165802c8-5150-48e3-9add-861d2ffd9c00 Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: POST /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments HTTP/1.1 Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 74 Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:57:18.577232 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {"volumeAttachment": {"volumeId": "29b8faf3-947f-4f0b-90e7-7a66a040f993"}} Aug 22 12:57:18.578822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Invalid volume: volume 29b8faf3-947f-4f0b-90e7-7a66a040f993 is already attached to instances: 165802c8-5150-48e3-9add-861d2ffd9c00 Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'server_id': '165802c8-5150-48e3-9add-861d2ffd9c00', 'body': {'volumeAttachment': {'volumeId': '29b8faf3-947f-4f0b-90e7-7a66a040f993'}}} Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 29b8faf3-947f-4f0b-90e7-7a66a040f993 is already attached to instances: 165802c8-5150-48e3-9add-861d2ffd9c00 Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:18.579618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 29b8faf3-947f-4f0b-90e7-7a66a040f993 is already attached to instances: 165802c8-5150-48e3-9add-861d2ffd9c00 Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:57:18.580860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:57:18.582131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:57:18.582131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:57:18.582131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:57:18.582131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 29b8faf3-947f-4f0b-90e7-7a66a040f993 is already attached to instances: 165802c8-5150-48e3-9add-861d2ffd9c00 Aug 22 12:57:18.582131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:18.582131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 400 to user: Invalid volume: volume 29b8faf3-947f-4f0b-90e7-7a66a040f993 is already attached to instances: 165802c8-5150-48e3-9add-861d2ffd9c00 {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:57:18.582131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7324cb71-964c-41ac-b6d7-dd6e8a0eef9a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.341357 Aug 22 12:57:18.583887 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 439/874] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:57:18 2022] POST /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments => generated 174 bytes in 346 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 12:57:18.656865 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3431d478-ba88-4fc8-a837-a7cf57d8f21d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:18.657516 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-3431d478-ba88-4fc8-a837-a7cf57d8f21d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:18.664179 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3431d478-ba88-4fc8-a837-a7cf57d8f21d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:18.664684 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3431d478-ba88-4fc8-a837-a7cf57d8f21d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:18.665128 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3431d478-ba88-4fc8-a837-a7cf57d8f21d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:18.665849 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3431d478-ba88-4fc8-a837-a7cf57d8f21d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:18.666358 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3431d478-ba88-4fc8-a837-a7cf57d8f21d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:18.666796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3431d478-ba88-4fc8-a837-a7cf57d8f21d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:18.749227 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-3431d478-ba88-4fc8-a837-a7cf57d8f21d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lazy-loading 'services' on Instance uuid 165802c8-5150-48e3-9add-861d2ffd9c00 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:57:19.019995 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-3431d478-ba88-4fc8-a837-a7cf57d8f21d tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments/29b8faf3-947f-4f0b-90e7-7a66a040f993" status: 202 len: 0 microversion: 2.1 time: 0.368888 Aug 22 12:57:19.021249 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 436/875] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 12:57:18 2022] DELETE /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments/29b8faf3-947f-4f0b-90e7-7a66a040f993 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:57:19.031438 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-856f96d0-892d-4b57-ab14-bcbb0d21abef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:19.033619 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-856f96d0-892d-4b57-ab14-bcbb0d21abef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:19.045904 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-856f96d0-892d-4b57-ab14-bcbb0d21abef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:19.046427 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-856f96d0-892d-4b57-ab14-bcbb0d21abef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:19.046877 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-856f96d0-892d-4b57-ab14-bcbb0d21abef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:19.047593 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-856f96d0-892d-4b57-ab14-bcbb0d21abef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:19.048056 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-856f96d0-892d-4b57-ab14-bcbb0d21abef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:19.048489 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-856f96d0-892d-4b57-ab14-bcbb0d21abef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:19.080733 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-856f96d0-892d-4b57-ab14-bcbb0d21abef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054667 Aug 22 12:57:19.081295 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 440/876] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:57:19 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:20.094134 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6799c13d-998e-4e83-9e99-908f27c425b0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:20.097408 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6799c13d-998e-4e83-9e99-908f27c425b0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:20.107400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6799c13d-998e-4e83-9e99-908f27c425b0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:20.108126 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6799c13d-998e-4e83-9e99-908f27c425b0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:20.108640 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6799c13d-998e-4e83-9e99-908f27c425b0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:20.111289 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6799c13d-998e-4e83-9e99-908f27c425b0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:20.111852 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6799c13d-998e-4e83-9e99-908f27c425b0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:20.112366 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6799c13d-998e-4e83-9e99-908f27c425b0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:20.160026 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6799c13d-998e-4e83-9e99-908f27c425b0 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070617 Aug 22 12:57:20.160934 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 437/877] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:57:20 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:21.182453 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-481231c5-79a6-4cac-af55-7c8b2ae8668f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:21.182959 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-481231c5-79a6-4cac-af55-7c8b2ae8668f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:21.197991 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-481231c5-79a6-4cac-af55-7c8b2ae8668f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:21.199425 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-481231c5-79a6-4cac-af55-7c8b2ae8668f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:21.199893 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-481231c5-79a6-4cac-af55-7c8b2ae8668f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:21.201160 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-481231c5-79a6-4cac-af55-7c8b2ae8668f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:21.201662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-481231c5-79a6-4cac-af55-7c8b2ae8668f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:21.202104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-481231c5-79a6-4cac-af55-7c8b2ae8668f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:21.264129 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-481231c5-79a6-4cac-af55-7c8b2ae8668f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095517 Aug 22 12:57:21.271034 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 441/878] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:57:21 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 12:57:21.345269 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bd392e60-e5f3-4836-8343-3bebb08c5a90 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:21.345861 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bd392e60-e5f3-4836-8343-3bebb08c5a90 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:21.351911 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd392e60-e5f3-4836-8343-3bebb08c5a90 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:21.352400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd392e60-e5f3-4836-8343-3bebb08c5a90 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:21.352835 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd392e60-e5f3-4836-8343-3bebb08c5a90 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:21.361014 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd392e60-e5f3-4836-8343-3bebb08c5a90 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:21.361014 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd392e60-e5f3-4836-8343-3bebb08c5a90 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:21.361014 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd392e60-e5f3-4836-8343-3bebb08c5a90 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:21.400125 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bd392e60-e5f3-4836-8343-3bebb08c5a90 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:57:21.756526 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bd392e60-e5f3-4836-8343-3bebb08c5a90 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 204 len: 0 microversion: 2.1 time: 0.415656 Aug 22 12:57:21.757121 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 438/879] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:57:21 2022] DELETE /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:57:21.767506 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ff8b1214-730c-49f6-bdac-11cf371270a4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:21.768119 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ff8b1214-730c-49f6-bdac-11cf371270a4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:21.774342 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff8b1214-730c-49f6-bdac-11cf371270a4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:21.775160 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff8b1214-730c-49f6-bdac-11cf371270a4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:21.775679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff8b1214-730c-49f6-bdac-11cf371270a4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:21.776682 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff8b1214-730c-49f6-bdac-11cf371270a4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:21.777144 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff8b1214-730c-49f6-bdac-11cf371270a4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:21.777644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ff8b1214-730c-49f6-bdac-11cf371270a4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:21.943132 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ff8b1214-730c-49f6-bdac-11cf371270a4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:21.952497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ff8b1214-730c-49f6-bdac-11cf371270a4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1682 microversion: 2.1 time: 0.190251 Aug 22 12:57:21.967936 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 442/880] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:21 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:22.976946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b0cd3250-2744-4239-b214-362eb86c761c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:22.978219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b0cd3250-2744-4239-b214-362eb86c761c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:22.985553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b0cd3250-2744-4239-b214-362eb86c761c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:22.986252 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b0cd3250-2744-4239-b214-362eb86c761c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:22.986892 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b0cd3250-2744-4239-b214-362eb86c761c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:22.987845 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b0cd3250-2744-4239-b214-362eb86c761c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:22.988471 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b0cd3250-2744-4239-b214-362eb86c761c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:22.989061 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b0cd3250-2744-4239-b214-362eb86c761c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:23.166829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b0cd3250-2744-4239-b214-362eb86c761c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:23.166829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b0cd3250-2744-4239-b214-362eb86c761c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1682 microversion: 2.1 time: 0.179980 Aug 22 12:57:23.166829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 439/881] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:22 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:24.187164 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e850a829-c6aa-4712-8627-eb2d3356be8c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:24.188626 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e850a829-c6aa-4712-8627-eb2d3356be8c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:24.196031 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e850a829-c6aa-4712-8627-eb2d3356be8c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:24.196927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e850a829-c6aa-4712-8627-eb2d3356be8c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:24.197644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e850a829-c6aa-4712-8627-eb2d3356be8c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:24.198453 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e850a829-c6aa-4712-8627-eb2d3356be8c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:24.199486 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e850a829-c6aa-4712-8627-eb2d3356be8c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:24.200705 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e850a829-c6aa-4712-8627-eb2d3356be8c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:24.394461 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e850a829-c6aa-4712-8627-eb2d3356be8c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:24.399639 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-805e7fc3-dbc9-4d7e-91a4-f39f7ce9b49d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Action: 'create', calling method: .version_select at 0x7f7659cd4790>, body: {"keypair": {"name": "tempest-TestShelveInstance-53318661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkfUkZ47cwiPb0u9UsQiRsLCbb48xFn4Kf4Sp8usCy635UGHELMStvDlH2IMy+yYQRASOMI+ZnKt6f6A+4gbW9KVBHEn2WPXlL3EDLvOEqigcW9NrjC8Ryd6cn9JmW3NA=="}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:24.409047 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e850a829-c6aa-4712-8627-eb2d3356be8c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1682 microversion: 2.1 time: 0.221929 Aug 22 12:57:24.410148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 443/882] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:24 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:24.425128 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-805e7fc3-dbc9-4d7e-91a4-f39f7ce9b49d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Getting quotas for project 5b4fa853dfd2483c8a3c2ac357f1af52. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:57:24.429850 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-805e7fc3-dbc9-4d7e-91a4-f39f7ce9b49d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Getting quotas for user bf10481821f149659859eff51f9c8cbb and project 5b4fa853dfd2483c8a3c2ac357f1af52. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:57:24.512492 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-805e7fc3-dbc9-4d7e-91a4-f39f7ce9b49d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.265173 Aug 22 12:57:24.513697 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 440/883] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 22 12:57:24 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:57:24.647043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-1511ab06-6af6-4391-89d3-baf80af7a2c2 req-a78d45b5-2bf5-4037-bac3-88474819df19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165802c8-5150-48e3-9add-861d2ffd9c00", "name": "network-vif-deleted", "tag": "e8a32dc3-2017-4c97-b29a-40f4fe57374b"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:24.658641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-1511ab06-6af6-4391-89d3-baf80af7a2c2 req-a78d45b5-2bf5-4037-bac3-88474819df19 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:24.659247 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-1511ab06-6af6-4391-89d3-baf80af7a2c2 req-a78d45b5-2bf5-4037-bac3-88474819df19 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:24.659807 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-1511ab06-6af6-4391-89d3-baf80af7a2c2 req-a78d45b5-2bf5-4037-bac3-88474819df19 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:24.681630 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-1511ab06-6af6-4391-89d3-baf80af7a2c2 req-a78d45b5-2bf5-4037-bac3-88474819df19 service nova] Creating event network-vif-deleted:e8a32dc3-2017-4c97-b29a-40f4fe57374b for instance 165802c8-5150-48e3-9add-861d2ffd9c00 on hv-cinder-85083 Aug 22 12:57:24.705049 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-1511ab06-6af6-4391-89d3-baf80af7a2c2 req-a78d45b5-2bf5-4037-bac3-88474819df19 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061708 Aug 22 12:57:24.709862 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 444/884] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:57:25.431987 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:25.432606 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:25.441034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:25.441539 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:25.441979 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:25.442738 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:25.443202 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:25.443634 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:25.480658 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:25.481169 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:25.481643 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:25.483452 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lazy-loading 'fault' on Instance uuid 165802c8-5150-48e3-9add-861d2ffd9c00 {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:57:25.541175 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:25.550007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-26694868-6990-4fa8-a1f9-59e6b3632a56 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 200 len: 1332 microversion: 2.1 time: 0.121928 Aug 22 12:57:25.550613 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 441/885] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:25 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 1332 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:26.578731 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:26.579438 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:26.585516 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:26.586001 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:26.586471 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:26.587174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:26.587634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:26.588066 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:26.601980 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 HTTP/1.1 Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:57:26.603664 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:57:26.605750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '165802c8-5150-48e3-9add-861d2ffd9c00'} Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:57:26.606800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:57:26.608644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:26.610114 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:57:26.610114 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-56286f91-74b3-4371-9caa-9d9dff106fcf tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 404 len: 111 microversion: 2.1 time: 0.031840 Aug 22 12:57:26.610114 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 445/886] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:26 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:57:26.614263 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d3bb3a27-3eb8-4d0d-a9d7-07a17c02b5fd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '.version_select at 0x7f7659cc2c10>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:26.704929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d3bb3a27-3eb8-4d0d-a9d7-07a17c02b5fd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014103216" status: 202 len: 0 microversion: 2.1 time: 0.094426 Aug 22 12:57:26.706075 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 442/887] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 22 12:57:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014103216 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:57:27.457064 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-51cf9004-b9d9-40f0-abb6-03740febece4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: .version_select at 0x7f7659e291f0>, body: {"keypair": {"name": "tempest-keypair-2006815497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVE8A8G16e9XWt1+TSm0JjQs6XfMNgkDN5N9+PkrBS2yR88Reqq4eBBhFqOUkWGaUq3eMbDQ7jFqFu/FfMpQAgeXAc97nxwXffBSGitdqbqowEcAhLYloJ5+yrQW7Hmaw=="}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:27.472542 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-51cf9004-b9d9-40f0-abb6-03740febece4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'key_pairs'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:57:27.476347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-51cf9004-b9d9-40f0-abb6-03740febece4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for user 74e80391b8814b44b13a6b38d36b15ee and project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'key_pairs'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:57:27.601292 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-51cf9004-b9d9-40f0-abb6-03740febece4 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.144512 Aug 22 12:57:27.601292 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 446/888] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 22 12:57:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:30.299135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-140781026", "imageRef": "e3606ee9-d32e-4f52-b3e2-adeac571d194", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45d598ec-3137-4425-8c25-3a2a4913d98a"}], "security_groups": [{"name": "tempest-securitygroup--1625275438"}], "key_name": "tempest-keypair-2006815497", "user_data": "}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:30.404357 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] validate_networks() for [('45d598ec-3137-4425-8c25-3a2a4913d98a', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:57:30.804748 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:57:30.805175 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:57:30.805643 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:57:30.806246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:57:30.806833 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:57:30.821103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:30.821103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:30.821103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:30.821103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:30.821501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:30.821501 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:30.840280 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:57:30.845612 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Getting quotas for user 74e80391b8814b44b13a6b38d36b15ee and project e9e4366467b5436d9dcfe2618cd735cc. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:57:30.857058 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:57:30.859380 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3606ee9-d32e-4f52-b3e2-adeac571d194',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:57:30.987536 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ee5d7e36-b3df-4e38-997c-ede4fe0f49ef tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.693809 Aug 22 12:57:30.988289 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 443/889] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:57:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:57:30.999780 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3bc4d74b-f78a-4611-959e-366aa79e12ce tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:31.000399 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3bc4d74b-f78a-4611-959e-366aa79e12ce tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:31.055689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3bc4d74b-f78a-4611-959e-366aa79e12ce tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:31.062706 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3bc4d74b-f78a-4611-959e-366aa79e12ce tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1241 microversion: 2.1 time: 0.067396 Aug 22 12:57:31.063268 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 447/890] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:30 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:32.085079 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9fcc39c0-7724-4e0c-a2e5-7ecf14b06575 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:32.085840 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9fcc39c0-7724-4e0c-a2e5-7ecf14b06575 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:32.091948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fcc39c0-7724-4e0c-a2e5-7ecf14b06575 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:32.092971 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fcc39c0-7724-4e0c-a2e5-7ecf14b06575 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:32.096405 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fcc39c0-7724-4e0c-a2e5-7ecf14b06575 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:32.096405 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fcc39c0-7724-4e0c-a2e5-7ecf14b06575 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:32.096405 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fcc39c0-7724-4e0c-a2e5-7ecf14b06575 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:32.096405 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9fcc39c0-7724-4e0c-a2e5-7ecf14b06575 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:32.160893 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-9fcc39c0-7724-4e0c-a2e5-7ecf14b06575 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:32.168838 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9fcc39c0-7724-4e0c-a2e5-7ecf14b06575 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1245 microversion: 2.1 time: 0.088222 Aug 22 12:57:32.169411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 444/891] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:32 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:33.190921 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6b6ac0db-d2d9-4f45-b8a9-f56df0be9c66 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:33.192128 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6b6ac0db-d2d9-4f45-b8a9-f56df0be9c66 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:33.198468 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6b6ac0db-d2d9-4f45-b8a9-f56df0be9c66 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:33.198960 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6b6ac0db-d2d9-4f45-b8a9-f56df0be9c66 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:33.199401 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6b6ac0db-d2d9-4f45-b8a9-f56df0be9c66 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:33.200100 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6b6ac0db-d2d9-4f45-b8a9-f56df0be9c66 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:33.200555 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6b6ac0db-d2d9-4f45-b8a9-f56df0be9c66 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:33.200981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6b6ac0db-d2d9-4f45-b8a9-f56df0be9c66 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:33.286813 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6b6ac0db-d2d9-4f45-b8a9-f56df0be9c66 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:33.295504 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6b6ac0db-d2d9-4f45-b8a9-f56df0be9c66 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1311 microversion: 2.1 time: 0.108395 Aug 22 12:57:33.296104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 448/892] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:33 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:34.316089 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0a16d5ce-1a41-46ad-8339-f7d34f85ee05 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:34.316736 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0a16d5ce-1a41-46ad-8339-f7d34f85ee05 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:34.328358 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a16d5ce-1a41-46ad-8339-f7d34f85ee05 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:34.328807 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a16d5ce-1a41-46ad-8339-f7d34f85ee05 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:34.329243 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a16d5ce-1a41-46ad-8339-f7d34f85ee05 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:34.330143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a16d5ce-1a41-46ad-8339-f7d34f85ee05 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:34.330622 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a16d5ce-1a41-46ad-8339-f7d34f85ee05 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:34.350530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0a16d5ce-1a41-46ad-8339-f7d34f85ee05 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:34.467985 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0a16d5ce-1a41-46ad-8339-f7d34f85ee05 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:34.475578 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0a16d5ce-1a41-46ad-8339-f7d34f85ee05 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1367 microversion: 2.1 time: 0.163237 Aug 22 12:57:34.476143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 445/893] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:34 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:34.916319 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-c34c6e06-f4f9-45d7-94a7-b09a1cbb3501 req-c49c8d27-aae6-4baa-b481-fc0fe162ee8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2919c3f3-54a6-4bee-a047-34c565348f9a", "tag": "31267b1a-4e2c-4f5c-8a9b-9a2d461d9cf9"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:34.927728 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c34c6e06-f4f9-45d7-94a7-b09a1cbb3501 req-c49c8d27-aae6-4baa-b481-fc0fe162ee8b service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:34.928253 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c34c6e06-f4f9-45d7-94a7-b09a1cbb3501 req-c49c8d27-aae6-4baa-b481-fc0fe162ee8b service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:34.928691 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c34c6e06-f4f9-45d7-94a7-b09a1cbb3501 req-c49c8d27-aae6-4baa-b481-fc0fe162ee8b service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:34.940372 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-c34c6e06-f4f9-45d7-94a7-b09a1cbb3501 req-c49c8d27-aae6-4baa-b481-fc0fe162ee8b service nova] Creating event network-changed:31267b1a-4e2c-4f5c-8a9b-9a2d461d9cf9 for instance 2919c3f3-54a6-4bee-a047-34c565348f9a on hv-cinder-85083 Aug 22 12:57:34.946209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-c34c6e06-f4f9-45d7-94a7-b09a1cbb3501 req-c49c8d27-aae6-4baa-b481-fc0fe162ee8b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033399 Aug 22 12:57:34.946829 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 449/894] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:35.496786 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-585f8d25-ad37-450c-a8dd-83b970bde062 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:35.497407 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-585f8d25-ad37-450c-a8dd-83b970bde062 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:35.504065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-585f8d25-ad37-450c-a8dd-83b970bde062 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:35.504634 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-585f8d25-ad37-450c-a8dd-83b970bde062 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:35.505140 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-585f8d25-ad37-450c-a8dd-83b970bde062 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:35.505845 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-585f8d25-ad37-450c-a8dd-83b970bde062 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:35.506340 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-585f8d25-ad37-450c-a8dd-83b970bde062 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:35.506770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-585f8d25-ad37-450c-a8dd-83b970bde062 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:35.645064 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-585f8d25-ad37-450c-a8dd-83b970bde062 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:35.652910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-585f8d25-ad37-450c-a8dd-83b970bde062 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1367 microversion: 2.1 time: 0.159898 Aug 22 12:57:35.653480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 446/895] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:35 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:36.673460 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2adcfe12-2dce-41c1-bf20-37a04899ead5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:36.674067 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2adcfe12-2dce-41c1-bf20-37a04899ead5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:36.680789 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2adcfe12-2dce-41c1-bf20-37a04899ead5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:36.681235 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2adcfe12-2dce-41c1-bf20-37a04899ead5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:36.681674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2adcfe12-2dce-41c1-bf20-37a04899ead5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:36.682392 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2adcfe12-2dce-41c1-bf20-37a04899ead5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:36.682862 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2adcfe12-2dce-41c1-bf20-37a04899ead5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:36.683268 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2adcfe12-2dce-41c1-bf20-37a04899ead5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:36.814982 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2adcfe12-2dce-41c1-bf20-37a04899ead5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:36.824839 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2adcfe12-2dce-41c1-bf20-37a04899ead5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1367 microversion: 2.1 time: 0.155631 Aug 22 12:57:36.825415 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 450/896] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:36 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:37.845382 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2d09d9fe-f6fe-411c-a8f2-98d7b93bb579 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:37.845990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2d09d9fe-f6fe-411c-a8f2-98d7b93bb579 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:37.852329 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d09d9fe-f6fe-411c-a8f2-98d7b93bb579 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:37.859988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d09d9fe-f6fe-411c-a8f2-98d7b93bb579 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:37.859988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d09d9fe-f6fe-411c-a8f2-98d7b93bb579 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:37.859988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d09d9fe-f6fe-411c-a8f2-98d7b93bb579 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:37.859988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d09d9fe-f6fe-411c-a8f2-98d7b93bb579 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:37.860426 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2d09d9fe-f6fe-411c-a8f2-98d7b93bb579 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:37.983428 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2d09d9fe-f6fe-411c-a8f2-98d7b93bb579 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:37.991307 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2d09d9fe-f6fe-411c-a8f2-98d7b93bb579 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1367 microversion: 2.1 time: 0.150344 Aug 22 12:57:37.991871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 447/897] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:37 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:39.012382 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3f058f6e-3271-465a-9081-64f342fcf968 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:39.013042 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3f058f6e-3271-465a-9081-64f342fcf968 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:39.020036 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f058f6e-3271-465a-9081-64f342fcf968 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:39.020526 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f058f6e-3271-465a-9081-64f342fcf968 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:39.020962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f058f6e-3271-465a-9081-64f342fcf968 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:39.021650 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f058f6e-3271-465a-9081-64f342fcf968 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:39.022106 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f058f6e-3271-465a-9081-64f342fcf968 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:39.031013 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f058f6e-3271-465a-9081-64f342fcf968 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:39.162783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3f058f6e-3271-465a-9081-64f342fcf968 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:39.170411 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3f058f6e-3271-465a-9081-64f342fcf968 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1367 microversion: 2.1 time: 0.161858 Aug 22 12:57:39.170970 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 451/898] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:39 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:40.190917 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-4215996e-904b-4c66-a4d6-8816217d37cb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:40.191739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-4215996e-904b-4c66-a4d6-8816217d37cb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:40.194121 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:40.202297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4215996e-904b-4c66-a4d6-8816217d37cb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:40.202936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4215996e-904b-4c66-a4d6-8816217d37cb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:40.203429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4215996e-904b-4c66-a4d6-8816217d37cb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:40.204148 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4215996e-904b-4c66-a4d6-8816217d37cb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:40.204785 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4215996e-904b-4c66-a4d6-8816217d37cb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:40.205273 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4215996e-904b-4c66-a4d6-8816217d37cb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:40.209568 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:40.339154 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4215996e-904b-4c66-a4d6-8816217d37cb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:40.347372 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-4215996e-904b-4c66-a4d6-8816217d37cb tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1367 microversion: 2.1 time: 0.160237 Aug 22 12:57:40.348125 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 448/899] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:40 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:40.382816 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-c76de839-11ec-4db1-9d15-cdffbdd40c48 req-066575e8-2f51-4e83-a97e-96db7897607e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2919c3f3-54a6-4bee-a047-34c565348f9a", "name": "network-vif-plugged", "status": "completed", "tag": "31267b1a-4e2c-4f5c-8a9b-9a2d461d9cf9"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:40.392770 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c76de839-11ec-4db1-9d15-cdffbdd40c48 req-066575e8-2f51-4e83-a97e-96db7897607e service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:40.393340 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c76de839-11ec-4db1-9d15-cdffbdd40c48 req-066575e8-2f51-4e83-a97e-96db7897607e service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:40.393777 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-c76de839-11ec-4db1-9d15-cdffbdd40c48 req-066575e8-2f51-4e83-a97e-96db7897607e service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:40.404460 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-c76de839-11ec-4db1-9d15-cdffbdd40c48 req-066575e8-2f51-4e83-a97e-96db7897607e service nova] Creating event network-vif-plugged:31267b1a-4e2c-4f5c-8a9b-9a2d461d9cf9 for instance 2919c3f3-54a6-4bee-a047-34c565348f9a on hv-cinder-85083 Aug 22 12:57:40.409667 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-c76de839-11ec-4db1-9d15-cdffbdd40c48 req-066575e8-2f51-4e83-a97e-96db7897607e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030787 Aug 22 12:57:40.410264 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 452/900] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:41.369516 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d5540387-8d0f-4ed8-9b0e-7fca39a0b9aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:41.370076 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-d5540387-8d0f-4ed8-9b0e-7fca39a0b9aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:41.372491 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:41.373142 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=10 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:41.379847 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5540387-8d0f-4ed8-9b0e-7fca39a0b9aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:41.380343 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5540387-8d0f-4ed8-9b0e-7fca39a0b9aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:41.383679 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5540387-8d0f-4ed8-9b0e-7fca39a0b9aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:41.383679 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5540387-8d0f-4ed8-9b0e-7fca39a0b9aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:41.383679 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5540387-8d0f-4ed8-9b0e-7fca39a0b9aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:41.383679 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5540387-8d0f-4ed8-9b0e-7fca39a0b9aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:41.512072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d5540387-8d0f-4ed8-9b0e-7fca39a0b9aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:41.519488 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d5540387-8d0f-4ed8-9b0e-7fca39a0b9aa tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1367 microversion: 2.1 time: 0.153831 Aug 22 12:57:41.520046 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 449/901] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:41 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:42.537253 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=6 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:42.542339 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-31410084-fd05-4c66-8c9c-ff396882ffe8 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:42.543118 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-31410084-fd05-4c66-8c9c-ff396882ffe8 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:42.549452 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31410084-fd05-4c66-8c9c-ff396882ffe8 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:42.550018 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31410084-fd05-4c66-8c9c-ff396882ffe8 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:42.550555 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31410084-fd05-4c66-8c9c-ff396882ffe8 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:42.551322 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31410084-fd05-4c66-8c9c-ff396882ffe8 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:42.551844 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31410084-fd05-4c66-8c9c-ff396882ffe8 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:42.552476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-31410084-fd05-4c66-8c9c-ff396882ffe8 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:42.692251 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-31410084-fd05-4c66-8c9c-ff396882ffe8 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:42.710843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-31410084-fd05-4c66-8c9c-ff396882ffe8 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1367 microversion: 2.1 time: 0.174546 Aug 22 12:57:42.711434 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 453/902] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:42 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:42.802280 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1298794576", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-53318661", "security_groups": [{"name": "tempest-secgroup-smoke-1208657997"}], "networks": [{"uuid": "269e922a-5c42-444d-ad66-12cf8d5235d1"}], "block_device_mapping_v2": [{"uuid": "b78a7971-1d66-47d2-b76f-1bdc664e73c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:42.914308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] validate_networks() for [('269e922a-5c42-444d-ad66-12cf8d5235d1', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:57:43.275519 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:57:43.275943 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:57:43.276420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:57:43.276827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:57:43.277236 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:57:43.285872 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:43.286390 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:43.286827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:43.287557 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:43.288015 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:43.288443 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:43.304771 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Getting quotas for project 5b4fa853dfd2483c8a3c2ac357f1af52. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:57:43.308494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Getting quotas for user bf10481821f149659859eff51f9c8cbb and project 5b4fa853dfd2483c8a3c2ac357f1af52. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:57:43.366506 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:57:43.368538 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b78a7971-1d66-47d2-b76f-1bdc664e73c0',volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:57:43.730985 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-79f3e642-f170-46a0-9fe0-eb11af34979f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:43.731588 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-79f3e642-f170-46a0-9fe0-eb11af34979f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:43.738743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79f3e642-f170-46a0-9fe0-eb11af34979f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:43.739295 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79f3e642-f170-46a0-9fe0-eb11af34979f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:43.739730 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79f3e642-f170-46a0-9fe0-eb11af34979f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:43.740419 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79f3e642-f170-46a0-9fe0-eb11af34979f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:43.740867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79f3e642-f170-46a0-9fe0-eb11af34979f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:43.741432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-79f3e642-f170-46a0-9fe0-eb11af34979f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:43.758733 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e0de27ba-57f6-4718-810e-6bc342e54715 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.960881 Aug 22 12:57:43.759682 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 450/903] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:57:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:57:43.775220 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0e4ccc89-bee3-4c2a-9202-0ee460a059ae tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:43.775860 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0e4ccc89-bee3-4c2a-9202-0ee460a059ae tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:43.855816 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0e4ccc89-bee3-4c2a-9202-0ee460a059ae tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:43.864268 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0e4ccc89-bee3-4c2a-9202-0ee460a059ae tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1087 microversion: 2.1 time: 0.097243 Aug 22 12:57:43.864972 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 451/904] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:43 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1087 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:57:43.916106 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-79f3e642-f170-46a0-9fe0-eb11af34979f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:43.923841 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-79f3e642-f170-46a0-9fe0-eb11af34979f tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1556 microversion: 2.1 time: 0.196986 Aug 22 12:57:43.925030 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 454/905] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:43 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1556 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:57:43.944209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9221219d-dba7-4335-9c48-4d9052760474 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:43.944701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9221219d-dba7-4335-9c48-4d9052760474 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:43.950974 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9221219d-dba7-4335-9c48-4d9052760474 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:43.951456 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9221219d-dba7-4335-9c48-4d9052760474 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:43.951889 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9221219d-dba7-4335-9c48-4d9052760474 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:43.952574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9221219d-dba7-4335-9c48-4d9052760474 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:43.953025 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9221219d-dba7-4335-9c48-4d9052760474 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:43.953444 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9221219d-dba7-4335-9c48-4d9052760474 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:44.033379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9221219d-dba7-4335-9c48-4d9052760474 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092869 Aug 22 12:57:44.034612 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 452/906] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 22 12:57:43 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:44.885454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f8459828-32a4-4312-abc9-6be8f64da718 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:44.886063 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f8459828-32a4-4312-abc9-6be8f64da718 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:44.974674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f8459828-32a4-4312-abc9-6be8f64da718 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:44.983628 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f8459828-32a4-4312-abc9-6be8f64da718 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1087 microversion: 2.1 time: 0.101858 Aug 22 12:57:44.984204 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 455/907] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:44 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1087 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:45.048699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-97d9f8e6-f314-453f-bdc3-f84f17601efb req-5ffb7259-8f9a-4f86-9aff-d30a85ef8690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2919c3f3-54a6-4bee-a047-34c565348f9a", "tag": "31267b1a-4e2c-4f5c-8a9b-9a2d461d9cf9"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:45.059437 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-97d9f8e6-f314-453f-bdc3-f84f17601efb req-5ffb7259-8f9a-4f86-9aff-d30a85ef8690 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:45.059938 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-97d9f8e6-f314-453f-bdc3-f84f17601efb req-5ffb7259-8f9a-4f86-9aff-d30a85ef8690 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:45.060372 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-97d9f8e6-f314-453f-bdc3-f84f17601efb req-5ffb7259-8f9a-4f86-9aff-d30a85ef8690 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:45.072129 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-97d9f8e6-f314-453f-bdc3-f84f17601efb req-5ffb7259-8f9a-4f86-9aff-d30a85ef8690 service nova] Creating event network-changed:31267b1a-4e2c-4f5c-8a9b-9a2d461d9cf9 for instance 2919c3f3-54a6-4bee-a047-34c565348f9a on hv-cinder-85083 Aug 22 12:57:45.077108 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-97d9f8e6-f314-453f-bdc3-f84f17601efb req-5ffb7259-8f9a-4f86-9aff-d30a85ef8690 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032812 Aug 22 12:57:45.077700 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 453/908] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:46.005338 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6873f262-7693-4d11-ae63-abf2591ef7c2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:46.005962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6873f262-7693-4d11-ae63-abf2591ef7c2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:46.015248 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6873f262-7693-4d11-ae63-abf2591ef7c2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:46.015742 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6873f262-7693-4d11-ae63-abf2591ef7c2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:46.016181 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6873f262-7693-4d11-ae63-abf2591ef7c2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:46.016885 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6873f262-7693-4d11-ae63-abf2591ef7c2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:46.017543 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6873f262-7693-4d11-ae63-abf2591ef7c2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:46.017966 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6873f262-7693-4d11-ae63-abf2591ef7c2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:46.090519 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6873f262-7693-4d11-ae63-abf2591ef7c2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:46.099728 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6873f262-7693-4d11-ae63-abf2591ef7c2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1185 microversion: 2.1 time: 0.098994 Aug 22 12:57:46.100462 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 456/909] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:45 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:47.121597 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ec034cb7-234b-4615-9bad-d226afb8fdea tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:47.122429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ec034cb7-234b-4615-9bad-d226afb8fdea tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:47.130423 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ec034cb7-234b-4615-9bad-d226afb8fdea tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:47.131454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ec034cb7-234b-4615-9bad-d226afb8fdea tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:47.132505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ec034cb7-234b-4615-9bad-d226afb8fdea tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:47.133582 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ec034cb7-234b-4615-9bad-d226afb8fdea tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:47.134277 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ec034cb7-234b-4615-9bad-d226afb8fdea tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:47.134927 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ec034cb7-234b-4615-9bad-d226afb8fdea tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:47.285877 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ec034cb7-234b-4615-9bad-d226afb8fdea tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:47.294040 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ec034cb7-234b-4615-9bad-d226afb8fdea tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1271 microversion: 2.1 time: 0.176773 Aug 22 12:57:47.294650 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 454/910] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:47 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:47.842895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-48031865-e722-472b-a883-e6576aab7f5b req-c9ed37eb-d481-4b04-b810-a7a5fe365c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b42279-7db6-4c28-8557-014f54e9afef", "tag": "9a28b39e-e983-4692-a43c-7821a73d6e5b"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:47.852615 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-48031865-e722-472b-a883-e6576aab7f5b req-c9ed37eb-d481-4b04-b810-a7a5fe365c54 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:47.853092 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-48031865-e722-472b-a883-e6576aab7f5b req-c9ed37eb-d481-4b04-b810-a7a5fe365c54 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:47.853524 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-48031865-e722-472b-a883-e6576aab7f5b req-c9ed37eb-d481-4b04-b810-a7a5fe365c54 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:47.864927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-48031865-e722-472b-a883-e6576aab7f5b req-c9ed37eb-d481-4b04-b810-a7a5fe365c54 service nova] Creating event network-changed:9a28b39e-e983-4692-a43c-7821a73d6e5b for instance b4b42279-7db6-4c28-8557-014f54e9afef on hv-cinder-85083 Aug 22 12:57:47.869688 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-48031865-e722-472b-a883-e6576aab7f5b req-c9ed37eb-d481-4b04-b810-a7a5fe365c54 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030464 Aug 22 12:57:47.870286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 457/911] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:48.315223 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-be3784f5-c11d-4555-b616-3f80f74b2a2e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:48.315839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-be3784f5-c11d-4555-b616-3f80f74b2a2e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:48.322455 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-be3784f5-c11d-4555-b616-3f80f74b2a2e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:48.322946 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-be3784f5-c11d-4555-b616-3f80f74b2a2e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:48.323384 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-be3784f5-c11d-4555-b616-3f80f74b2a2e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:48.324085 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-be3784f5-c11d-4555-b616-3f80f74b2a2e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:48.324549 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-be3784f5-c11d-4555-b616-3f80f74b2a2e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:48.324985 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-be3784f5-c11d-4555-b616-3f80f74b2a2e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:48.455168 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-be3784f5-c11d-4555-b616-3f80f74b2a2e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:48.463366 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-be3784f5-c11d-4555-b616-3f80f74b2a2e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1259 microversion: 2.1 time: 0.152036 Aug 22 12:57:48.463967 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 455/912] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:48 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:49.484365 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-37562f0f-1717-43d9-9d57-e38a2c84d3de tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:49.484985 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-37562f0f-1717-43d9-9d57-e38a2c84d3de tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:49.486905 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:49.491729 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37562f0f-1717-43d9-9d57-e38a2c84d3de tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:49.492199 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37562f0f-1717-43d9-9d57-e38a2c84d3de tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:49.492641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37562f0f-1717-43d9-9d57-e38a2c84d3de tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:49.493343 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37562f0f-1717-43d9-9d57-e38a2c84d3de tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:49.493800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37562f0f-1717-43d9-9d57-e38a2c84d3de tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:49.494247 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37562f0f-1717-43d9-9d57-e38a2c84d3de tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:49.496874 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=81 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:49.628338 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-37562f0f-1717-43d9-9d57-e38a2c84d3de tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:49.635986 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-37562f0f-1717-43d9-9d57-e38a2c84d3de tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1259 microversion: 2.1 time: 0.156631 Aug 22 12:57:49.636551 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 458/913] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:49 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:50.370658 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1cc9b70f-cfe0-4740-b25d-e0c615133b9f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:50.371183 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1cc9b70f-cfe0-4740-b25d-e0c615133b9f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:50.377173 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cc9b70f-cfe0-4740-b25d-e0c615133b9f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:50.377663 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cc9b70f-cfe0-4740-b25d-e0c615133b9f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:50.378091 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cc9b70f-cfe0-4740-b25d-e0c615133b9f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:50.378798 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cc9b70f-cfe0-4740-b25d-e0c615133b9f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:50.379252 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cc9b70f-cfe0-4740-b25d-e0c615133b9f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:50.379675 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1cc9b70f-cfe0-4740-b25d-e0c615133b9f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:50.404464 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1cc9b70f-cfe0-4740-b25d-e0c615133b9f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:57:50.656962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e0f47022-15c5-432e-ab28-1119519aa77a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:50.657482 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e0f47022-15c5-432e-ab28-1119519aa77a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:50.663927 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e0f47022-15c5-432e-ab28-1119519aa77a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:50.664417 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e0f47022-15c5-432e-ab28-1119519aa77a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:50.664860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e0f47022-15c5-432e-ab28-1119519aa77a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:50.665555 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e0f47022-15c5-432e-ab28-1119519aa77a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:50.666016 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e0f47022-15c5-432e-ab28-1119519aa77a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:50.666473 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e0f47022-15c5-432e-ab28-1119519aa77a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:50.680047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1cc9b70f-cfe0-4740-b25d-e0c615133b9f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 204 len: 0 microversion: 2.1 time: 0.313014 Aug 22 12:57:50.680617 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 456/914] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:57:50 2022] DELETE /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:57:50.688890 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-4b1019ec-b31f-4212-bc9c-d22c71e02e56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:50.689588 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-4b1019ec-b31f-4212-bc9c-d22c71e02e56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:50.695994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b1019ec-b31f-4212-bc9c-d22c71e02e56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:50.696476 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b1019ec-b31f-4212-bc9c-d22c71e02e56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:50.696910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b1019ec-b31f-4212-bc9c-d22c71e02e56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:50.697609 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b1019ec-b31f-4212-bc9c-d22c71e02e56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:50.698065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b1019ec-b31f-4212-bc9c-d22c71e02e56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:50.698529 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4b1019ec-b31f-4212-bc9c-d22c71e02e56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:50.873450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e0f47022-15c5-432e-ab28-1119519aa77a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:50.881658 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e0f47022-15c5-432e-ab28-1119519aa77a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1259 microversion: 2.1 time: 0.228675 Aug 22 12:57:50.882237 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 459/915] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:50 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:57:50.892180 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4b1019ec-b31f-4212-bc9c-d22c71e02e56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:50.899889 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-4b1019ec-b31f-4212-bc9c-d22c71e02e56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1579 microversion: 2.1 time: 0.214972 Aug 22 12:57:50.900442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 457/916] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:50 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1579 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:57:51.902562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-1a3b39e8-ada3-4e60-8746-2b1ac117f46c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:51.903172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-1a3b39e8-ada3-4e60-8746-2b1ac117f46c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:51.909690 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a3b39e8-ada3-4e60-8746-2b1ac117f46c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:51.910825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a3b39e8-ada3-4e60-8746-2b1ac117f46c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:51.911379 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a3b39e8-ada3-4e60-8746-2b1ac117f46c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:51.912106 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a3b39e8-ada3-4e60-8746-2b1ac117f46c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:51.912566 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a3b39e8-ada3-4e60-8746-2b1ac117f46c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:51.912994 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-1a3b39e8-ada3-4e60-8746-2b1ac117f46c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:51.920581 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-aac88860-5b08-448b-9c9a-e59110af610b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:51.921186 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-aac88860-5b08-448b-9c9a-e59110af610b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:51.927708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aac88860-5b08-448b-9c9a-e59110af610b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:51.928209 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aac88860-5b08-448b-9c9a-e59110af610b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:51.928651 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aac88860-5b08-448b-9c9a-e59110af610b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:51.929554 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aac88860-5b08-448b-9c9a-e59110af610b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:51.930030 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aac88860-5b08-448b-9c9a-e59110af610b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:51.930492 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-aac88860-5b08-448b-9c9a-e59110af610b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:52.130564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-1a3b39e8-ada3-4e60-8746-2b1ac117f46c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:52.133782 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-aac88860-5b08-448b-9c9a-e59110af610b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:52.138525 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-1a3b39e8-ada3-4e60-8746-2b1ac117f46c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1259 microversion: 2.1 time: 0.239854 Aug 22 12:57:52.139493 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 460/917] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:51 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:52.141333 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-aac88860-5b08-448b-9c9a-e59110af610b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1579 microversion: 2.1 time: 0.224553 Aug 22 12:57:52.141889 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 458/918] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:51 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1579 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:57:53.159422 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b42d9db7-2c63-46a4-a7e8-f5aae8422b68 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:53.160618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b42d9db7-2c63-46a4-a7e8-f5aae8422b68 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:53.163437 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-888bea83-c2f5-420c-ab65-31d0fcfe2226 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:53.164051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-888bea83-c2f5-420c-ab65-31d0fcfe2226 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:53.167161 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b42d9db7-2c63-46a4-a7e8-f5aae8422b68 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:53.167651 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b42d9db7-2c63-46a4-a7e8-f5aae8422b68 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:53.168080 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b42d9db7-2c63-46a4-a7e8-f5aae8422b68 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:53.168778 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b42d9db7-2c63-46a4-a7e8-f5aae8422b68 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:53.169405 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b42d9db7-2c63-46a4-a7e8-f5aae8422b68 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:53.169865 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b42d9db7-2c63-46a4-a7e8-f5aae8422b68 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:53.170277 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-888bea83-c2f5-420c-ab65-31d0fcfe2226 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:53.170770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-888bea83-c2f5-420c-ab65-31d0fcfe2226 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:53.171201 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-888bea83-c2f5-420c-ab65-31d0fcfe2226 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:53.171895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-888bea83-c2f5-420c-ab65-31d0fcfe2226 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:53.172345 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-888bea83-c2f5-420c-ab65-31d0fcfe2226 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:53.172761 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-888bea83-c2f5-420c-ab65-31d0fcfe2226 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:53.256509 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-888bea83-c2f5-420c-ab65-31d0fcfe2226 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:53.267589 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-888bea83-c2f5-420c-ab65-31d0fcfe2226 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1511 microversion: 2.1 time: 0.109445 Aug 22 12:57:53.281315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 459/919] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:53 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1511 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:57:53.323969 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-5c2b6307-0830-451a-8624-5d8b568c2b9f req-584d0cb0-bfe9-47f7-9ccb-2a164e575f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c83c81-7a50-4a24-a5c4-59c2af75792c", "name": "network-vif-deleted", "tag": "c17bd0f3-f66e-4dd2-88c9-53a8231814ff"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:53.329369 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:53.335712 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-5c2b6307-0830-451a-8624-5d8b568c2b9f req-584d0cb0-bfe9-47f7-9ccb-2a164e575f86 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:53.336198 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-5c2b6307-0830-451a-8624-5d8b568c2b9f req-584d0cb0-bfe9-47f7-9ccb-2a164e575f86 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:53.336773 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-5c2b6307-0830-451a-8624-5d8b568c2b9f req-584d0cb0-bfe9-47f7-9ccb-2a164e575f86 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:53.340107 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b42d9db7-2c63-46a4-a7e8-f5aae8422b68 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:53.349770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-5c2b6307-0830-451a-8624-5d8b568c2b9f req-584d0cb0-bfe9-47f7-9ccb-2a164e575f86 service nova] Creating event network-vif-deleted:c17bd0f3-f66e-4dd2-88c9-53a8231814ff for instance a4c83c81-7a50-4a24-a5c4-59c2af75792c on hv-cinder-85083 Aug 22 12:57:53.350286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b42d9db7-2c63-46a4-a7e8-f5aae8422b68 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1259 microversion: 2.1 time: 0.195144 Aug 22 12:57:53.354207 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 461/920] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:53 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:53.354997 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-5c2b6307-0830-451a-8624-5d8b568c2b9f req-584d0cb0-bfe9-47f7-9ccb-2a164e575f86 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034520 Aug 22 12:57:53.356004 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 460/921] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:54.292906 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:54.293526 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:54.300077 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:54.301273 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:54.301624 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:54.302354 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:54.302820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:54.303249 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:54.333617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:54.334100 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:54.334568 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:54.335012 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lazy-loading 'fault' on Instance uuid a4c83c81-7a50-4a24-a5c4-59c2af75792c {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:57:54.367991 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=8 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:54.373060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c1cbead1-9ef6-45e2-b14b-059af002386f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:54.373974 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c1cbead1-9ef6-45e2-b14b-059af002386f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:54.375947 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:54.380336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1cbead1-9ef6-45e2-b14b-059af002386f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:54.380897 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1cbead1-9ef6-45e2-b14b-059af002386f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:54.381448 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1cbead1-9ef6-45e2-b14b-059af002386f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:54.382429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1cbead1-9ef6-45e2-b14b-059af002386f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:54.382891 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1cbead1-9ef6-45e2-b14b-059af002386f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:54.383964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-38736177-e668-413c-98db-1cd33e55b7ca tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 200 len: 1231 microversion: 2.1 time: 0.094922 Aug 22 12:57:54.387572 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c1cbead1-9ef6-45e2-b14b-059af002386f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:54.388701 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 462/922] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:54 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:54.520677 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c1cbead1-9ef6-45e2-b14b-059af002386f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:54.532953 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c1cbead1-9ef6-45e2-b14b-059af002386f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1259 microversion: 2.1 time: 0.165667 Aug 22 12:57:54.533542 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 461/923] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:54 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:57:55.407945 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:55.408611 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:55.410332 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:55.415498 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:55.415984 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:55.416422 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:55.417115 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:55.417571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:55.417999 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:55.431450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] HTTP exception thrown: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Request method failure captured: Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c HTTP/1.1 Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3yTwuST5r9fL1c_dUZDanGAXYCGhSx7ErDhX51j-bsg-MclPAaHS2XiuibCslWy_d4pEBuGv-tu35_sCIEq6UFyHD4RSx-B4zqdWTeq7NEBinZ_f8HO1Hbbl147E5CEiK_eo0i7pqkm6uCc6wlbHSnpD5ZPIUCcENCUQpg1_CFakYE Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 66ab7e2f4bbd43f4a795a5f1068a32f9 Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-TestVolumeBootPattern-288792624 Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:57:55.433171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}] Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-TestVolumeBootPattern-288792624 Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 66ab7e2f4bbd43f4a795a5f1068a32f9 Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-TestVolumeBootPattern-288792624 Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-TestVolumeBootPattern-288792624-project Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 35306cf75bde4fdcbb1374fa9ab82aa7 Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-TestVolumeBootPattern-288792624-project Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 12:57:55.434922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': 'a4c83c81-7a50-4a24-a5c4-59c2af75792c'} Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:57:55.435797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 12:57:55.437187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:57:55.438700 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Returning 404 to user: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:57:55.438700 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7938f0a0-136c-4066-b8ef-f9914a53e723 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 404 len: 111 microversion: 2.1 time: 0.030524 Aug 22 12:57:55.438700 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 463/924] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:55 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:57:55.530634 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1349656036", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1880130090", "security_groups": [{"name": "tempest-secgroup-smoke-2114417346"}], "block_device_mapping_v2": [{"uuid": "b18c0366-c6fe-4974-a870-4084115eb376", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f69688de-f377-4c85-a58c-b5ac46ea4c35"}]}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:55.555369 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d001e7a2-8eea-4c3b-a006-bc7d729bf15f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:55.584625 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d001e7a2-8eea-4c3b-a006-bc7d729bf15f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:55.584625 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d001e7a2-8eea-4c3b-a006-bc7d729bf15f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:55.584625 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d001e7a2-8eea-4c3b-a006-bc7d729bf15f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:55.584625 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d001e7a2-8eea-4c3b-a006-bc7d729bf15f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:55.585740 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d001e7a2-8eea-4c3b-a006-bc7d729bf15f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:55.585740 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d001e7a2-8eea-4c3b-a006-bc7d729bf15f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:55.585740 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d001e7a2-8eea-4c3b-a006-bc7d729bf15f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:55.695557 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] validate_networks() for [('f69688de-f377-4c85-a58c-b5ac46ea4c35', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 12:57:55.976645 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d001e7a2-8eea-4c3b-a006-bc7d729bf15f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:55.984792 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d001e7a2-8eea-4c3b-a006-bc7d729bf15f tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1259 microversion: 2.1 time: 0.432997 Aug 22 12:57:55.985367 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 464/925] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:55 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1259 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:56.349423 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 12:57:56.349842 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 12:57:56.350345 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 12:57:56.350752 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 12:57:56.351158 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 12:57:56.359962 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:56.360438 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:56.360865 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:56.361604 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:56.362060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:56.362505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:56.378724 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Getting quotas for project 66ab7e2f4bbd43f4a795a5f1068a32f9. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 12:57:56.382613 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Getting quotas for user 35306cf75bde4fdcbb1374fa9ab82aa7 and project 66ab7e2f4bbd43f4a795a5f1068a32f9. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 12:57:56.442020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 12:57:56.444266 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b18c0366-c6fe-4974-a870-4084115eb376',volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 12:57:56.917048 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-22d2590a-58c0-4fec-9e0a-7a7c18bbbd67 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.390188 Aug 22 12:57:56.918497 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 462/926] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 12:57:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 12:57:56.930104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c0aed584-1b86-4e66-ad46-2a6cbda39b16 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:56.931340 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c0aed584-1b86-4e66-ad46-2a6cbda39b16 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:57.000740 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c0aed584-1b86-4e66-ad46-2a6cbda39b16 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:57.005244 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-57335e1d-784d-4e73-8982-35aa26073756 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:57.005866 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-57335e1d-784d-4e73-8982-35aa26073756 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:57.008643 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c0aed584-1b86-4e66-ad46-2a6cbda39b16 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1095 microversion: 2.1 time: 0.082847 Aug 22 12:57:57.009815 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 465/927] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:56 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:57.013400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57335e1d-784d-4e73-8982-35aa26073756 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:57.013886 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57335e1d-784d-4e73-8982-35aa26073756 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:57.014353 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57335e1d-784d-4e73-8982-35aa26073756 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:57.020750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57335e1d-784d-4e73-8982-35aa26073756 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:57.021236 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57335e1d-784d-4e73-8982-35aa26073756 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:57.021692 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57335e1d-784d-4e73-8982-35aa26073756 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:57.162513 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-57335e1d-784d-4e73-8982-35aa26073756 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:57.170111 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-57335e1d-784d-4e73-8982-35aa26073756 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1259 microversion: 2.1 time: 0.169255 Aug 22 12:57:57.170705 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 463/928] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:56 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:57:58.028873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0e34a478-b538-4c34-829a-b5dc1f00deba tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:58.029513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0e34a478-b538-4c34-829a-b5dc1f00deba tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:58.037044 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e34a478-b538-4c34-829a-b5dc1f00deba tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:58.037532 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e34a478-b538-4c34-829a-b5dc1f00deba tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:58.037967 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e34a478-b538-4c34-829a-b5dc1f00deba tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:58.038696 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e34a478-b538-4c34-829a-b5dc1f00deba tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:58.039152 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e34a478-b538-4c34-829a-b5dc1f00deba tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:58.039584 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0e34a478-b538-4c34-829a-b5dc1f00deba tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:58.103293 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0e34a478-b538-4c34-829a-b5dc1f00deba tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:58.111215 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0e34a478-b538-4c34-829a-b5dc1f00deba tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1145 microversion: 2.1 time: 0.086207 Aug 22 12:57:58.111759 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 466/929] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:58 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:58.190672 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-81899714-1048-4640-978a-7647efe3ff0a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:58.191297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-81899714-1048-4640-978a-7647efe3ff0a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:58.197816 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81899714-1048-4640-978a-7647efe3ff0a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:58.198342 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81899714-1048-4640-978a-7647efe3ff0a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:58.198835 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81899714-1048-4640-978a-7647efe3ff0a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:58.199544 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81899714-1048-4640-978a-7647efe3ff0a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:58.200008 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81899714-1048-4640-978a-7647efe3ff0a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:58.200437 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-81899714-1048-4640-978a-7647efe3ff0a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:58.332930 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-81899714-1048-4640-978a-7647efe3ff0a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:58.343466 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-81899714-1048-4640-978a-7647efe3ff0a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1259 microversion: 2.1 time: 0.155137 Aug 22 12:57:58.343466 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 464/930] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:58 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:58.585174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-cf811451-dc96-4904-97cf-0a837b657b14 req-17fae942-9171-4a27-a65e-7c458966c424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b42279-7db6-4c28-8557-014f54e9afef", "name": "network-vif-plugged", "status": "completed", "tag": "9a28b39e-e983-4692-a43c-7821a73d6e5b"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:57:58.594503 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-cf811451-dc96-4904-97cf-0a837b657b14 req-17fae942-9171-4a27-a65e-7c458966c424 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:58.594981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-cf811451-dc96-4904-97cf-0a837b657b14 req-17fae942-9171-4a27-a65e-7c458966c424 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:58.595402 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-cf811451-dc96-4904-97cf-0a837b657b14 req-17fae942-9171-4a27-a65e-7c458966c424 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:58.608773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-cf811451-dc96-4904-97cf-0a837b657b14 req-17fae942-9171-4a27-a65e-7c458966c424 service nova] Creating event network-vif-plugged:9a28b39e-e983-4692-a43c-7821a73d6e5b for instance b4b42279-7db6-4c28-8557-014f54e9afef on hv-cinder-85083 Aug 22 12:57:58.614102 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-cf811451-dc96-4904-97cf-0a837b657b14 req-17fae942-9171-4a27-a65e-7c458966c424 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089756 Aug 22 12:57:58.614788 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 467/931] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:57:59.146689 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0471b67a-746b-4cd1-8877-5de8bc4fa44d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:59.146689 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0471b67a-746b-4cd1-8877-5de8bc4fa44d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:59.146689 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0471b67a-746b-4cd1-8877-5de8bc4fa44d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:59.146689 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0471b67a-746b-4cd1-8877-5de8bc4fa44d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:59.147282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0471b67a-746b-4cd1-8877-5de8bc4fa44d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:59.147282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0471b67a-746b-4cd1-8877-5de8bc4fa44d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:59.147282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0471b67a-746b-4cd1-8877-5de8bc4fa44d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:59.147282 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0471b67a-746b-4cd1-8877-5de8bc4fa44d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:59.226231 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-0471b67a-746b-4cd1-8877-5de8bc4fa44d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:59.235055 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0471b67a-746b-4cd1-8877-5de8bc4fa44d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1201 microversion: 2.1 time: 0.104360 Aug 22 12:57:59.238675 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 465/932] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:59 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1201 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:57:59.365924 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-986d9088-e348-4d6b-971e-d4f041a299cc tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:57:59.366675 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-986d9088-e348-4d6b-971e-d4f041a299cc tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:57:59.373211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-986d9088-e348-4d6b-971e-d4f041a299cc tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:59.373702 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-986d9088-e348-4d6b-971e-d4f041a299cc tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:59.374145 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-986d9088-e348-4d6b-971e-d4f041a299cc tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:59.374872 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-986d9088-e348-4d6b-971e-d4f041a299cc tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:57:59.375336 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-986d9088-e348-4d6b-971e-d4f041a299cc tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:57:59.375772 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-986d9088-e348-4d6b-971e-d4f041a299cc tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:57:59.511711 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-986d9088-e348-4d6b-971e-d4f041a299cc tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:57:59.519730 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-986d9088-e348-4d6b-971e-d4f041a299cc tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1259 microversion: 2.1 time: 0.159259 Aug 22 12:57:59.520610 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 468/933] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:57:59 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:00.257448 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-cdf16779-22ed-467b-92b7-83882577406c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:00.258062 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-cdf16779-22ed-467b-92b7-83882577406c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:00.264392 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdf16779-22ed-467b-92b7-83882577406c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:00.264879 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdf16779-22ed-467b-92b7-83882577406c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:00.265308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdf16779-22ed-467b-92b7-83882577406c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:00.266000 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdf16779-22ed-467b-92b7-83882577406c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:00.266478 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdf16779-22ed-467b-92b7-83882577406c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:00.266894 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-cdf16779-22ed-467b-92b7-83882577406c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:00.409615 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-cdf16779-22ed-467b-92b7-83882577406c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:00.417670 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-cdf16779-22ed-467b-92b7-83882577406c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1279 microversion: 2.1 time: 0.164580 Aug 22 12:58:00.418286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 466/934] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:00 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:00.540202 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e60bb349-f5eb-4d01-a5a7-838941697cc2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:00.540816 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e60bb349-f5eb-4d01-a5a7-838941697cc2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:00.547147 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e60bb349-f5eb-4d01-a5a7-838941697cc2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:00.547644 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e60bb349-f5eb-4d01-a5a7-838941697cc2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:00.548085 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e60bb349-f5eb-4d01-a5a7-838941697cc2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:00.548778 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e60bb349-f5eb-4d01-a5a7-838941697cc2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:00.549233 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e60bb349-f5eb-4d01-a5a7-838941697cc2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:00.549661 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e60bb349-f5eb-4d01-a5a7-838941697cc2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:00.677364 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-943c4ade-cb19-43d8-909c-cb0af4dc20b8 req-5883ef4f-8e81-4a48-9083-772c8b5f1df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8259dfc6-578c-47a3-9339-b92f749bef34", "tag": "d51a6416-9839-49d0-8553-55806f7230d1"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:58:00.688872 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-943c4ade-cb19-43d8-909c-cb0af4dc20b8 req-5883ef4f-8e81-4a48-9083-772c8b5f1df2 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:00.689767 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-943c4ade-cb19-43d8-909c-cb0af4dc20b8 req-5883ef4f-8e81-4a48-9083-772c8b5f1df2 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:00.690413 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-943c4ade-cb19-43d8-909c-cb0af4dc20b8 req-5883ef4f-8e81-4a48-9083-772c8b5f1df2 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:00.693797 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:00.700823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e60bb349-f5eb-4d01-a5a7-838941697cc2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:00.703354 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-943c4ade-cb19-43d8-909c-cb0af4dc20b8 req-5883ef4f-8e81-4a48-9083-772c8b5f1df2 service nova] Creating event network-changed:d51a6416-9839-49d0-8553-55806f7230d1 for instance 8259dfc6-578c-47a3-9339-b92f749bef34 on hv-cinder-85083 Aug 22 12:58:00.710668 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-943c4ade-cb19-43d8-909c-cb0af4dc20b8 req-5883ef4f-8e81-4a48-9083-772c8b5f1df2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116738 Aug 22 12:58:00.714565 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e60bb349-f5eb-4d01-a5a7-838941697cc2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1444 microversion: 2.1 time: 0.174366 Aug 22 12:58:00.715239 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 467/935] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:58:00.715332 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 469/936] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:00 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1444 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:00.730586 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a1371010-cd44-47d5-8356-840770707227 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:00.731542 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a1371010-cd44-47d5-8356-840770707227 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:00.738768 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a1371010-cd44-47d5-8356-840770707227 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:00.739251 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a1371010-cd44-47d5-8356-840770707227 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:00.739701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a1371010-cd44-47d5-8356-840770707227 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:00.740380 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a1371010-cd44-47d5-8356-840770707227 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:00.740833 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a1371010-cd44-47d5-8356-840770707227 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:00.741253 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a1371010-cd44-47d5-8356-840770707227 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:00.894978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a1371010-cd44-47d5-8356-840770707227 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:00.903072 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a1371010-cd44-47d5-8356-840770707227 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1444 microversion: 2.1 time: 0.176492 Aug 22 12:58:00.904026 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 468/937] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:00 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:58:01.438389 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f47b7551-e11a-45c9-8911-92044b816251 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:01.439277 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f47b7551-e11a-45c9-8911-92044b816251 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:01.445939 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f47b7551-e11a-45c9-8911-92044b816251 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:01.446678 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f47b7551-e11a-45c9-8911-92044b816251 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:01.447126 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f47b7551-e11a-45c9-8911-92044b816251 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:01.447816 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f47b7551-e11a-45c9-8911-92044b816251 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:01.448272 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f47b7551-e11a-45c9-8911-92044b816251 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:01.448695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f47b7551-e11a-45c9-8911-92044b816251 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:01.662403 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f47b7551-e11a-45c9-8911-92044b816251 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:01.670125 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f47b7551-e11a-45c9-8911-92044b816251 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.235521 Aug 22 12:58:01.674999 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 470/938] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:01 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:02.692042 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-859fd909-cb74-45c1-acc8-ec99dbcc53f5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:02.692832 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-859fd909-cb74-45c1-acc8-ec99dbcc53f5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:02.699600 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-859fd909-cb74-45c1-acc8-ec99dbcc53f5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:02.700093 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-859fd909-cb74-45c1-acc8-ec99dbcc53f5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:02.700535 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-859fd909-cb74-45c1-acc8-ec99dbcc53f5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:02.701241 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-859fd909-cb74-45c1-acc8-ec99dbcc53f5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:02.701705 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-859fd909-cb74-45c1-acc8-ec99dbcc53f5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:02.702130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-859fd909-cb74-45c1-acc8-ec99dbcc53f5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:02.845656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-859fd909-cb74-45c1-acc8-ec99dbcc53f5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:02.854077 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-859fd909-cb74-45c1-acc8-ec99dbcc53f5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.166238 Aug 22 12:58:02.854688 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 469/939] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:02 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:03.010250 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-55a61e9b-882a-46b9-a5f6-04fde77daf06 req-9e56b546-18e6-4a7c-9201-b6bf6930a447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b42279-7db6-4c28-8557-014f54e9afef", "tag": "9a28b39e-e983-4692-a43c-7821a73d6e5b"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:58:03.022846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-55a61e9b-882a-46b9-a5f6-04fde77daf06 req-9e56b546-18e6-4a7c-9201-b6bf6930a447 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:03.022846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-55a61e9b-882a-46b9-a5f6-04fde77daf06 req-9e56b546-18e6-4a7c-9201-b6bf6930a447 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:03.022846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-55a61e9b-882a-46b9-a5f6-04fde77daf06 req-9e56b546-18e6-4a7c-9201-b6bf6930a447 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:03.032693 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-55a61e9b-882a-46b9-a5f6-04fde77daf06 req-9e56b546-18e6-4a7c-9201-b6bf6930a447 service nova] Creating event network-changed:9a28b39e-e983-4692-a43c-7821a73d6e5b for instance b4b42279-7db6-4c28-8557-014f54e9afef on hv-cinder-85083 Aug 22 12:58:03.039969 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-55a61e9b-882a-46b9-a5f6-04fde77daf06 req-9e56b546-18e6-4a7c-9201-b6bf6930a447 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090722 Aug 22 12:58:03.045859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 471/940] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:58:03.875360 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-76486626-3a66-41af-a82c-c1edf70081c2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:03.875965 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-76486626-3a66-41af-a82c-c1edf70081c2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:03.883005 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-76486626-3a66-41af-a82c-c1edf70081c2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:03.883484 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-76486626-3a66-41af-a82c-c1edf70081c2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:03.883912 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-76486626-3a66-41af-a82c-c1edf70081c2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:03.884704 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-76486626-3a66-41af-a82c-c1edf70081c2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:03.885160 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-76486626-3a66-41af-a82c-c1edf70081c2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:03.885580 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-76486626-3a66-41af-a82c-c1edf70081c2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:04.017094 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-76486626-3a66-41af-a82c-c1edf70081c2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:04.024798 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-76486626-3a66-41af-a82c-c1edf70081c2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.153331 Aug 22 12:58:04.025356 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 470/941] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:03 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:05.047214 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-907a0ed6-2e47-4d6f-a107-95e4d8464078 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:05.047917 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-907a0ed6-2e47-4d6f-a107-95e4d8464078 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:05.054172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-907a0ed6-2e47-4d6f-a107-95e4d8464078 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:05.054682 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-907a0ed6-2e47-4d6f-a107-95e4d8464078 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:05.055118 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-907a0ed6-2e47-4d6f-a107-95e4d8464078 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:05.055808 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-907a0ed6-2e47-4d6f-a107-95e4d8464078 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:05.056261 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-907a0ed6-2e47-4d6f-a107-95e4d8464078 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:05.056686 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-907a0ed6-2e47-4d6f-a107-95e4d8464078 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:05.187495 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-907a0ed6-2e47-4d6f-a107-95e4d8464078 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:05.195662 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-907a0ed6-2e47-4d6f-a107-95e4d8464078 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.153400 Aug 22 12:58:05.196240 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 472/942] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:05 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:58:06.216144 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-28911820-d656-4ad7-98ad-17e70c07ff56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:06.216757 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-28911820-d656-4ad7-98ad-17e70c07ff56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:06.223725 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28911820-d656-4ad7-98ad-17e70c07ff56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:06.224207 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28911820-d656-4ad7-98ad-17e70c07ff56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:06.224638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28911820-d656-4ad7-98ad-17e70c07ff56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:06.225325 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28911820-d656-4ad7-98ad-17e70c07ff56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:06.225781 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28911820-d656-4ad7-98ad-17e70c07ff56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:06.226222 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-28911820-d656-4ad7-98ad-17e70c07ff56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:06.357927 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-28911820-d656-4ad7-98ad-17e70c07ff56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:06.365572 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-28911820-d656-4ad7-98ad-17e70c07ff56 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.153233 Aug 22 12:58:06.366137 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 471/943] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:06 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:07.387914 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-825b423a-b1c9-4d94-85f6-9f73ba4849a7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:07.388449 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-825b423a-b1c9-4d94-85f6-9f73ba4849a7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:07.390901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:07.396263 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-825b423a-b1c9-4d94-85f6-9f73ba4849a7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:07.397674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-825b423a-b1c9-4d94-85f6-9f73ba4849a7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:07.397674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-825b423a-b1c9-4d94-85f6-9f73ba4849a7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:07.398045 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-825b423a-b1c9-4d94-85f6-9f73ba4849a7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:07.398527 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-825b423a-b1c9-4d94-85f6-9f73ba4849a7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:07.398954 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-825b423a-b1c9-4d94-85f6-9f73ba4849a7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:07.529589 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-825b423a-b1c9-4d94-85f6-9f73ba4849a7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:07.537884 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-825b423a-b1c9-4d94-85f6-9f73ba4849a7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.153831 Aug 22 12:58:07.538485 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 473/944] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:07 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:08.558435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8fc5aeb6-92ec-475a-89a1-eb11fa5f3ae8 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:08.559049 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8fc5aeb6-92ec-475a-89a1-eb11fa5f3ae8 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:08.560951 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:08.561609 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=6 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:08.566919 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8fc5aeb6-92ec-475a-89a1-eb11fa5f3ae8 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:08.569117 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8fc5aeb6-92ec-475a-89a1-eb11fa5f3ae8 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:08.569117 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8fc5aeb6-92ec-475a-89a1-eb11fa5f3ae8 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:08.569117 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8fc5aeb6-92ec-475a-89a1-eb11fa5f3ae8 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:08.569117 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8fc5aeb6-92ec-475a-89a1-eb11fa5f3ae8 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:08.569471 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8fc5aeb6-92ec-475a-89a1-eb11fa5f3ae8 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:08.699609 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8fc5aeb6-92ec-475a-89a1-eb11fa5f3ae8 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:08.707248 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8fc5aeb6-92ec-475a-89a1-eb11fa5f3ae8 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.152649 Aug 22 12:58:08.707813 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 472/945] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:08 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:09.728633 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6beaf5a4-4f91-429d-80dd-b186eba48581 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:09.729270 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6beaf5a4-4f91-429d-80dd-b186eba48581 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:09.735890 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6beaf5a4-4f91-429d-80dd-b186eba48581 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:09.736370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6beaf5a4-4f91-429d-80dd-b186eba48581 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:09.736805 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6beaf5a4-4f91-429d-80dd-b186eba48581 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:09.737490 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6beaf5a4-4f91-429d-80dd-b186eba48581 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:09.737941 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6beaf5a4-4f91-429d-80dd-b186eba48581 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:09.738396 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6beaf5a4-4f91-429d-80dd-b186eba48581 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:09.867349 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6beaf5a4-4f91-429d-80dd-b186eba48581 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:09.874846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6beaf5a4-4f91-429d-80dd-b186eba48581 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.150098 Aug 22 12:58:09.875402 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 474/946] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:09 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:10.895324 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7808ca56-44ff-4ceb-8e8f-3dd99e902700 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:10.895845 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7808ca56-44ff-4ceb-8e8f-3dd99e902700 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:10.902488 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7808ca56-44ff-4ceb-8e8f-3dd99e902700 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:10.902981 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7808ca56-44ff-4ceb-8e8f-3dd99e902700 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:10.903420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7808ca56-44ff-4ceb-8e8f-3dd99e902700 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:10.904152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7808ca56-44ff-4ceb-8e8f-3dd99e902700 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:10.904616 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7808ca56-44ff-4ceb-8e8f-3dd99e902700 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:10.905047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7808ca56-44ff-4ceb-8e8f-3dd99e902700 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:11.037174 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7808ca56-44ff-4ceb-8e8f-3dd99e902700 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:11.044766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7808ca56-44ff-4ceb-8e8f-3dd99e902700 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.153385 Aug 22 12:58:11.045362 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 473/947] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:10 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 12:58:12.065128 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-584003ba-32d6-42c4-bfaa-6bc2363903a2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:12.065729 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-584003ba-32d6-42c4-bfaa-6bc2363903a2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:12.072135 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584003ba-32d6-42c4-bfaa-6bc2363903a2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:12.072619 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584003ba-32d6-42c4-bfaa-6bc2363903a2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:12.073049 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584003ba-32d6-42c4-bfaa-6bc2363903a2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:12.073750 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584003ba-32d6-42c4-bfaa-6bc2363903a2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:12.074200 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584003ba-32d6-42c4-bfaa-6bc2363903a2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:12.074628 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-584003ba-32d6-42c4-bfaa-6bc2363903a2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:12.205330 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-584003ba-32d6-42c4-bfaa-6bc2363903a2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:12.213497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-584003ba-32d6-42c4-bfaa-6bc2363903a2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.152291 Aug 22 12:58:12.214050 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 475/948] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:12 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:12.649601 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-b659d7ec-d524-41ec-923f-31147e11c43b req-44434302-5e5b-40e7-9c0d-b1c7a1365ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8259dfc6-578c-47a3-9339-b92f749bef34", "name": "network-vif-plugged", "status": "completed", "tag": "d51a6416-9839-49d0-8553-55806f7230d1"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:58:12.654965 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:12.659910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-b659d7ec-d524-41ec-923f-31147e11c43b req-44434302-5e5b-40e7-9c0d-b1c7a1365ea3 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:12.660418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-b659d7ec-d524-41ec-923f-31147e11c43b req-44434302-5e5b-40e7-9c0d-b1c7a1365ea3 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:12.661934 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-b659d7ec-d524-41ec-923f-31147e11c43b req-44434302-5e5b-40e7-9c0d-b1c7a1365ea3 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:12.671486 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-b659d7ec-d524-41ec-923f-31147e11c43b req-44434302-5e5b-40e7-9c0d-b1c7a1365ea3 service nova] Creating event network-vif-plugged:d51a6416-9839-49d0-8553-55806f7230d1 for instance 8259dfc6-578c-47a3-9339-b92f749bef34 on hv-cinder-85083 Aug 22 12:58:12.676836 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-b659d7ec-d524-41ec-923f-31147e11c43b req-44434302-5e5b-40e7-9c0d-b1c7a1365ea3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030943 Aug 22 12:58:12.677396 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 474/949] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:58:13.234879 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-53138e7b-1a47-463b-8929-9fbd01b8cd10 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:13.235420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-53138e7b-1a47-463b-8929-9fbd01b8cd10 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:13.242351 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53138e7b-1a47-463b-8929-9fbd01b8cd10 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:13.242843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53138e7b-1a47-463b-8929-9fbd01b8cd10 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:13.243282 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53138e7b-1a47-463b-8929-9fbd01b8cd10 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:13.243979 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53138e7b-1a47-463b-8929-9fbd01b8cd10 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:13.244454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53138e7b-1a47-463b-8929-9fbd01b8cd10 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:13.244881 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-53138e7b-1a47-463b-8929-9fbd01b8cd10 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:13.376905 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-53138e7b-1a47-463b-8929-9fbd01b8cd10 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:13.384574 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-53138e7b-1a47-463b-8929-9fbd01b8cd10 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.154031 Aug 22 12:58:13.385133 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 476/950] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:13 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:14.406373 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-fce54268-a144-42aa-bf96-7a5b42a23b66 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:14.407075 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-fce54268-a144-42aa-bf96-7a5b42a23b66 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:14.414320 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fce54268-a144-42aa-bf96-7a5b42a23b66 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:14.414806 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fce54268-a144-42aa-bf96-7a5b42a23b66 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:14.415244 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fce54268-a144-42aa-bf96-7a5b42a23b66 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:14.415940 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fce54268-a144-42aa-bf96-7a5b42a23b66 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:14.416398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fce54268-a144-42aa-bf96-7a5b42a23b66 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:14.416827 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fce54268-a144-42aa-bf96-7a5b42a23b66 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:14.553341 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-fce54268-a144-42aa-bf96-7a5b42a23b66 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:14.560871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-fce54268-a144-42aa-bf96-7a5b42a23b66 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1267 microversion: 2.1 time: 0.159549 Aug 22 12:58:14.561441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 475/951] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:14 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:15.581091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-fb317993-3f06-4dc9-b67e-6f6f7ea43266 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:15.582429 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-fb317993-3f06-4dc9-b67e-6f6f7ea43266 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:15.588959 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb317993-3f06-4dc9-b67e-6f6f7ea43266 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:15.589444 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb317993-3f06-4dc9-b67e-6f6f7ea43266 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:15.589876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb317993-3f06-4dc9-b67e-6f6f7ea43266 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:15.590595 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb317993-3f06-4dc9-b67e-6f6f7ea43266 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:15.591045 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb317993-3f06-4dc9-b67e-6f6f7ea43266 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:15.591468 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fb317993-3f06-4dc9-b67e-6f6f7ea43266 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:15.606485 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=100 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:15.724243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-fb317993-3f06-4dc9-b67e-6f6f7ea43266 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:15.732104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-fb317993-3f06-4dc9-b67e-6f6f7ea43266 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1454 microversion: 2.1 time: 0.154865 Aug 22 12:58:15.732663 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 477/952] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:15 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:15.752235 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dec67581-b4b7-493f-8f2f-90f3b4be69af tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:15.752851 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-dec67581-b4b7-493f-8f2f-90f3b4be69af tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:15.759778 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dec67581-b4b7-493f-8f2f-90f3b4be69af tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:15.760262 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dec67581-b4b7-493f-8f2f-90f3b4be69af tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:15.760700 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dec67581-b4b7-493f-8f2f-90f3b4be69af tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:15.761389 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dec67581-b4b7-493f-8f2f-90f3b4be69af tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:15.761846 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dec67581-b4b7-493f-8f2f-90f3b4be69af tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:15.762307 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dec67581-b4b7-493f-8f2f-90f3b4be69af tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:15.893385 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-dec67581-b4b7-493f-8f2f-90f3b4be69af tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:15.900957 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-dec67581-b4b7-493f-8f2f-90f3b4be69af tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1454 microversion: 2.1 time: 0.152498 Aug 22 12:58:15.901517 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 476/953] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:15 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:17.901091 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-00441ac7-a997-40e6-9f22-d2285e806ccc req-e9cc22fd-2400-4d38-885b-df0e2f1ed66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8259dfc6-578c-47a3-9339-b92f749bef34", "tag": "d51a6416-9839-49d0-8553-55806f7230d1"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:58:17.911516 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-00441ac7-a997-40e6-9f22-d2285e806ccc req-e9cc22fd-2400-4d38-885b-df0e2f1ed66d service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:17.911987 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-00441ac7-a997-40e6-9f22-d2285e806ccc req-e9cc22fd-2400-4d38-885b-df0e2f1ed66d service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:17.912413 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-00441ac7-a997-40e6-9f22-d2285e806ccc req-e9cc22fd-2400-4d38-885b-df0e2f1ed66d service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:17.923454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-00441ac7-a997-40e6-9f22-d2285e806ccc req-e9cc22fd-2400-4d38-885b-df0e2f1ed66d service nova] Creating event network-changed:d51a6416-9839-49d0-8553-55806f7230d1 for instance 8259dfc6-578c-47a3-9339-b92f749bef34 on hv-cinder-85083 Aug 22 12:58:17.928564 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-00441ac7-a997-40e6-9f22-d2285e806ccc req-e9cc22fd-2400-4d38-885b-df0e2f1ed66d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031105 Aug 22 12:58:17.929368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 478/954] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 12:58:21.081814 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0d59e787-c979-4430-bb22-1eae75e42fda tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:21.082375 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0d59e787-c979-4430-bb22-1eae75e42fda tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:21.088213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0d59e787-c979-4430-bb22-1eae75e42fda tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:21.088756 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0d59e787-c979-4430-bb22-1eae75e42fda tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:21.089247 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0d59e787-c979-4430-bb22-1eae75e42fda tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:21.089933 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0d59e787-c979-4430-bb22-1eae75e42fda tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:21.090415 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0d59e787-c979-4430-bb22-1eae75e42fda tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:21.090836 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0d59e787-c979-4430-bb22-1eae75e42fda tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:21.112985 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0d59e787-c979-4430-bb22-1eae75e42fda tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/ips" status: 200 len: 149 microversion: 2.1 time: 0.084529 Aug 22 12:58:21.113523 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 477/955] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 22 12:58:21 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/ips => generated 149 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:58:22.673137 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c5b98f1d-a2d3-4878-856e-bd79be0b5220 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98b4da02-539b-424b-a1e7-475d09c89979"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:58:22.675591 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c5b98f1d-a2d3-4878-856e-bd79be0b5220 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:22.677980 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=46 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:22.682748 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5b98f1d-a2d3-4878-856e-bd79be0b5220 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:22.683227 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5b98f1d-a2d3-4878-856e-bd79be0b5220 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:22.683655 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5b98f1d-a2d3-4878-856e-bd79be0b5220 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:22.684338 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5b98f1d-a2d3-4878-856e-bd79be0b5220 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:22.684794 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5b98f1d-a2d3-4878-856e-bd79be0b5220 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:22.685266 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5b98f1d-a2d3-4878-856e-bd79be0b5220 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:23.415411 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c5b98f1d-a2d3-4878-856e-bd79be0b5220 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "POST /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747122 Aug 22 12:58:23.416062 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 479/956] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 12:58:22 2022] POST /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-volume_attachments => generated 194 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:58:31.034671 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e132aa8a-299d-4b98-8251-317ddd5e4046 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:31.035196 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e132aa8a-299d-4b98-8251-317ddd5e4046 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:31.042308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e132aa8a-299d-4b98-8251-317ddd5e4046 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:31.042814 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e132aa8a-299d-4b98-8251-317ddd5e4046 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:31.043237 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e132aa8a-299d-4b98-8251-317ddd5e4046 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:31.043939 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e132aa8a-299d-4b98-8251-317ddd5e4046 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:31.044403 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e132aa8a-299d-4b98-8251-317ddd5e4046 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:31.044832 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e132aa8a-299d-4b98-8251-317ddd5e4046 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:31.127108 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-e132aa8a-299d-4b98-8251-317ddd5e4046 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lazy-loading 'services' on Instance uuid 2919c3f3-54a6-4bee-a047-34c565348f9a {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:58:31.320322 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e132aa8a-299d-4b98-8251-317ddd5e4046 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-volume_attachments/98b4da02-539b-424b-a1e7-475d09c89979" status: 202 len: 0 microversion: 2.1 time: 0.289302 Aug 22 12:58:31.320912 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 478/957] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 12:58:31 2022] DELETE /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-volume_attachments/98b4da02-539b-424b-a1e7-475d09c89979 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:58:31.330763 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-40ab02b4-f97b-4560-babc-2281ef5c51bd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:31.334109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-40ab02b4-f97b-4560-babc-2281ef5c51bd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:31.340456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-40ab02b4-f97b-4560-babc-2281ef5c51bd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:31.343777 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-40ab02b4-f97b-4560-babc-2281ef5c51bd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:31.343777 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-40ab02b4-f97b-4560-babc-2281ef5c51bd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:31.343777 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-40ab02b4-f97b-4560-babc-2281ef5c51bd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:31.343777 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-40ab02b4-f97b-4560-babc-2281ef5c51bd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:31.344196 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-40ab02b4-f97b-4560-babc-2281ef5c51bd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:31.372789 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-40ab02b4-f97b-4560-babc-2281ef5c51bd tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047307 Aug 22 12:58:31.373342 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 480/958] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:58:31 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:58:32.386775 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-42a13215-ba91-4022-b242-6aa25f698bec tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:32.389002 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-42a13215-ba91-4022-b242-6aa25f698bec tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:32.395150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-42a13215-ba91-4022-b242-6aa25f698bec tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:32.395639 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-42a13215-ba91-4022-b242-6aa25f698bec tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:32.396081 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-42a13215-ba91-4022-b242-6aa25f698bec tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:32.396773 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-42a13215-ba91-4022-b242-6aa25f698bec tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:32.397232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-42a13215-ba91-4022-b242-6aa25f698bec tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:32.397658 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-42a13215-ba91-4022-b242-6aa25f698bec tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:32.426702 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-42a13215-ba91-4022-b242-6aa25f698bec tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Aug 22 12:58:32.427799 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 479/959] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:58:32 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:58:33.439651 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e2af964d-411a-43d1-b08a-d74192eb613a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:33.441775 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e2af964d-411a-43d1-b08a-d74192eb613a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:33.449053 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e2af964d-411a-43d1-b08a-d74192eb613a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:33.449544 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e2af964d-411a-43d1-b08a-d74192eb613a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:33.449987 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e2af964d-411a-43d1-b08a-d74192eb613a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:33.450716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e2af964d-411a-43d1-b08a-d74192eb613a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:33.451176 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e2af964d-411a-43d1-b08a-d74192eb613a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:33.451601 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e2af964d-411a-43d1-b08a-d74192eb613a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:33.482671 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e2af964d-411a-43d1-b08a-d74192eb613a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046854 Aug 22 12:58:33.483233 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 481/960] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 12:58:33 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 12:58:33.544994 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-fa677f4f-8007-453d-a48f-f794ca126f15 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:33.545496 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-fa677f4f-8007-453d-a48f-f794ca126f15 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:33.551845 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa677f4f-8007-453d-a48f-f794ca126f15 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:33.552848 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa677f4f-8007-453d-a48f-f794ca126f15 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:33.553283 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa677f4f-8007-453d-a48f-f794ca126f15 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:33.553981 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa677f4f-8007-453d-a48f-f794ca126f15 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:33.554536 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa677f4f-8007-453d-a48f-f794ca126f15 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:33.554966 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-fa677f4f-8007-453d-a48f-f794ca126f15 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:33.558955 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:33.581271 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-fa677f4f-8007-453d-a48f-f794ca126f15 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Going to try to terminate instance {{(pid=127809) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 12:58:33.879105 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-fa677f4f-8007-453d-a48f-f794ca126f15 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 204 len: 0 microversion: 2.1 time: 0.337638 Aug 22 12:58:33.879717 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 480/961] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:58:33 2022] DELETE /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 12:58:33.888513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f3148875-40a3-4d04-9b3a-52c6980b75b9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:33.889127 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f3148875-40a3-4d04-9b3a-52c6980b75b9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:33.895832 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f3148875-40a3-4d04-9b3a-52c6980b75b9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:33.896317 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f3148875-40a3-4d04-9b3a-52c6980b75b9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:33.896753 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f3148875-40a3-4d04-9b3a-52c6980b75b9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:33.897446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f3148875-40a3-4d04-9b3a-52c6980b75b9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:33.897902 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f3148875-40a3-4d04-9b3a-52c6980b75b9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:33.898504 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f3148875-40a3-4d04-9b3a-52c6980b75b9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:34.029502 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f3148875-40a3-4d04-9b3a-52c6980b75b9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:34.037681 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f3148875-40a3-4d04-9b3a-52c6980b75b9 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1681 microversion: 2.1 time: 0.153062 Aug 22 12:58:34.038267 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 482/962] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:33 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:35.059608 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e360f451-9564-4aa4-b9db-9d99ddbd568a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:35.060332 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e360f451-9564-4aa4-b9db-9d99ddbd568a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:35.066636 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e360f451-9564-4aa4-b9db-9d99ddbd568a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:35.067116 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e360f451-9564-4aa4-b9db-9d99ddbd568a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:35.067629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e360f451-9564-4aa4-b9db-9d99ddbd568a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:35.068826 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e360f451-9564-4aa4-b9db-9d99ddbd568a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:35.069278 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e360f451-9564-4aa4-b9db-9d99ddbd568a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:35.069697 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e360f451-9564-4aa4-b9db-9d99ddbd568a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:35.199873 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e360f451-9564-4aa4-b9db-9d99ddbd568a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:35.207404 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e360f451-9564-4aa4-b9db-9d99ddbd568a tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1681 microversion: 2.1 time: 0.151999 Aug 22 12:58:35.207963 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 481/963] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:35 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:36.228088 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0a766dad-61c5-4bba-9915-fd53acfe4d25 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:36.228643 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0a766dad-61c5-4bba-9915-fd53acfe4d25 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:36.235349 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0a766dad-61c5-4bba-9915-fd53acfe4d25 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:36.235866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0a766dad-61c5-4bba-9915-fd53acfe4d25 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:36.236300 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0a766dad-61c5-4bba-9915-fd53acfe4d25 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:36.236997 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0a766dad-61c5-4bba-9915-fd53acfe4d25 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:36.237483 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0a766dad-61c5-4bba-9915-fd53acfe4d25 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:36.237908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0a766dad-61c5-4bba-9915-fd53acfe4d25 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:36.368044 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0a766dad-61c5-4bba-9915-fd53acfe4d25 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:36.375654 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0a766dad-61c5-4bba-9915-fd53acfe4d25 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1681 microversion: 2.1 time: 0.151539 Aug 22 12:58:36.376211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 483/964] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:36 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:36.727934 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-c901c85c-5995-45a3-a82d-66945e42353d req-5d735d09-6c0a-41d3-a62f-9938c043c266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2919c3f3-54a6-4bee-a047-34c565348f9a", "name": "network-vif-deleted", "tag": "31267b1a-4e2c-4f5c-8a9b-9a2d461d9cf9"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 12:58:36.740819 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-c901c85c-5995-45a3-a82d-66945e42353d req-5d735d09-6c0a-41d3-a62f-9938c043c266 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:36.740819 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-c901c85c-5995-45a3-a82d-66945e42353d req-5d735d09-6c0a-41d3-a62f-9938c043c266 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:36.740819 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-c901c85c-5995-45a3-a82d-66945e42353d req-5d735d09-6c0a-41d3-a62f-9938c043c266 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:36.750149 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-c901c85c-5995-45a3-a82d-66945e42353d req-5d735d09-6c0a-41d3-a62f-9938c043c266 service nova] Creating event network-vif-deleted:31267b1a-4e2c-4f5c-8a9b-9a2d461d9cf9 for instance 2919c3f3-54a6-4bee-a047-34c565348f9a on hv-cinder-85083 Aug 22 12:58:36.755172 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-c901c85c-5995-45a3-a82d-66945e42353d req-5d735d09-6c0a-41d3-a62f-9938c043c266 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030998 Aug 22 12:58:36.755770 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 482/965] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 12:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 12:58:37.397530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:37.398146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:37.404595 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:37.405094 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:37.405539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:37.406296 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:37.406791 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:37.407222 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:37.439581 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:37.440077 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:37.440569 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:37.441025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lazy-loading 'fault' on Instance uuid 2919c3f3-54a6-4bee-a047-34c565348f9a {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 12:58:37.483975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e80391b8814b44b13a6b38d36b15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e4366467b5436d9dcfe2618cd735cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 12:58:37.492081 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3f363f7d-4d86-4394-b302-8b442cdec24b tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 200 len: 1331 microversion: 2.1 time: 0.098964 Aug 22 12:58:37.495760 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 484/966] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:37 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 12:58:38.513926 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:38.514666 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:38.520681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:38.521161 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:38.521590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:38.522304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:38.522757 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:38.523283 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:38.536155 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a HTTP/1.1 Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:58:38.538257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:38.539978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '2919c3f3-54a6-4bee-a047-34c565348f9a'} Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:58:38.541101 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:38.542699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:38.544308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:58:38.544308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c951f8a6-d84a-45bf-8900-2c96aac65ba5 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 404 len: 111 microversion: 2.1 time: 0.030324 Aug 22 12:58:38.544308 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 483/967] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:38 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:58:38.548161 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7c294ed5-e784-4c36-bf29-aaf43021df48 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '.version_select at 0x7f7659ea7790>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:38.624552 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7c294ed5-e784-4c36-bf29-aaf43021df48 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006815497" status: 202 len: 0 microversion: 2.1 time: 0.080093 Aug 22 12:58:38.625128 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 485/968] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 22 12:58:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006815497 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 12:58:40.564179 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:40.564669 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:40.570961 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:40.571448 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:40.571887 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:40.572574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:40.573033 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:40.573458 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:40.587253 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: DELETE /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a HTTP/1.1 Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:58:40.588824 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:40.590151 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '2919c3f3-54a6-4bee-a047-34c565348f9a'} Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:58:40.590978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:40.592229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:40.593511 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:58:40.593511 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c0a4b4f5-4017-4901-9db7-b907b5819590 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 404 len: 111 microversion: 2.1 time: 0.029887 Aug 22 12:58:40.593511 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 484/969] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:58:40 2022] DELETE /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:58:40.599150 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:40.600432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 2919c3f3-54a6-4bee-a047-34c565348f9a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:40.607490 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:40.607988 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:40.608433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:40.609150 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:40.609602 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:40.610034 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:40.623392 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a HTTP/1.1 Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:58:40.625043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:40.626507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '2919c3f3-54a6-4bee-a047-34c565348f9a'} Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:58:40.627329 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. Aug 22 12:58:40.628823 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:40.630958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 2919c3f3-54a6-4bee-a047-34c565348f9a could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:58:40.630958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b36fd1d0-e34a-482d-b2bf-4dc8493380a3 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a" status: 404 len: 111 microversion: 2.1 time: 0.031577 Aug 22 12:58:40.630958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 486/970] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:40 2022] GET /compute/v2.1/servers/2919c3f3-54a6-4bee-a047-34c565348f9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:58:41.862511 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:41.862993 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:41.869402 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:41.869895 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:41.870374 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:41.871102 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:41.871562 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:41.871991 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:41.884922 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: DELETE /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 HTTP/1.1 Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:58:41.886465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:58:41.888059 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '165802c8-5150-48e3-9add-861d2ffd9c00'} Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:58:41.889011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:58:41.890494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.892023 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:58:41.892023 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c10f7cac-35f8-4ff2-a66f-d38bf59ffb0c tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 404 len: 111 microversion: 2.1 time: 0.029088 Aug 22 12:58:41.892023 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 485/971] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:58:41 2022] DELETE /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:58:41.896169 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:41.897305 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 165802c8-5150-48e3-9add-861d2ffd9c00] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:41.903732 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:41.904219 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:41.904659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:41.905356 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:41.905814 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:41.906340 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:41.920096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 HTTP/1.1 Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:58:41.921598 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:58:41.923179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '165802c8-5150-48e3-9add-861d2ffd9c00'} Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:58:41.924153 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. Aug 22 12:58:41.925779 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.927107 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 165802c8-5150-48e3-9add-861d2ffd9c00 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:58:41.927107 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4c76d23b-1fc6-426c-8c42-343b12799f17 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00" status: 404 len: 111 microversion: 2.1 time: 0.030823 Aug 22 12:58:41.927107 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 487/972] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:41 2022] GET /compute/v2.1/servers/165802c8-5150-48e3-9add-861d2ffd9c00 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:58:41.931243 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:41.931751 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:41.937556 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:41.938044 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:41.938527 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:41.939223 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:41.939681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:41.940108 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:41.953129 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: DELETE /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a HTTP/1.1 Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:58:41.954667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:58:41.956213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '40c9cb84-5a6e-46f5-a67a-ba8cc838829a'} Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:58:41.957107 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:58:41.958788 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.960820 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:58:41.960820 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-dadc2979-1dd9-4932-a471-e658db00c089 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 404 len: 111 microversion: 2.1 time: 0.028562 Aug 22 12:58:41.960820 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 486/973] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:58:41 2022] DELETE /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 12:58:41.964747 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:41.965358 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 40c9cb84-5a6e-46f5-a67a-ba8cc838829a] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:41.971295 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:41.971785 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:41.972225 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:41.972921 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:41.973380 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:41.973811 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:41.987765 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a HTTP/1.1 Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:58:41.989278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:58:41.990867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '40c9cb84-5a6e-46f5-a67a-ba8cc838829a'} Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:58:41.991749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. Aug 22 12:58:41.993276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:41.994581 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 40c9cb84-5a6e-46f5-a67a-ba8cc838829a could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:58:41.994581 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6709f993-1a48-47bb-82cf-0e1e10e3ae3e tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a" status: 404 len: 111 microversion: 2.1 time: 0.029663 Aug 22 12:58:41.994581 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 488/974] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:41 2022] GET /compute/v2.1/servers/40c9cb84-5a6e-46f5-a67a-ba8cc838829a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:58:43.274850 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:43.275350 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:43.281725 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:43.282235 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:43.282681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:43.283376 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:43.283831 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:43.284257 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:43.298131 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: DELETE /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 HTTP/1.1 Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 12:58:43.299728 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:58:43.301398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '746985f5-95e3-4ad2-a997-67653768dfd3'} Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:58:43.302379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:58:43.303871 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 12:58:43.305513 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:58:43.305513 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d56d8775-94ce-4fb8-b328-5a7881d30448 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 404 len: 111 microversion: 2.1 time: 0.030658 Aug 22 12:58:43.305513 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 487/975] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 12:58:43 2022] DELETE /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 12:58:43.309450 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 12:58:43.310058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] [instance: 746985f5-95e3-4ad2-a997-67653768dfd3] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 12:58:43.316282 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:43.316761 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:43.317193 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:43.317878 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 12:58:43.318434 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 12:58:43.318861 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 12:58:43.332309 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] HTTP exception thrown: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Request method failure captured: Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 HTTP/1.1 Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3w_MuDvigimRhjfGu75uXUR3Sbb1_mwMKDmoCxb-RzTCjPX85RoErE2gCLQMN1O7uqhivPhhppMc-QeZp689cMfGNgyNJnjlznfQjBEAm150XL1XapIGaLShXi4j-lnT18iebNhcomGMInrnrgrCBt0xY1-B09ZRmmvu83iBZfVwMs Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 12:58:43.333871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e9e4366467b5436d9dcfe2618cd735cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e9e4366467b5436d9dcfe2618cd735cc"}]}] Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: e9e4366467b5436d9dcfe2618cd735cc Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2043746257 Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 74e80391b8814b44b13a6b38d36b15ee Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-AttachVolumeNegativeTest-2043746257-project Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:58:43.336014 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '746985f5-95e3-4ad2-a997-67653768dfd3'} Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 12:58:43.336958 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. Aug 22 12:58:43.338866 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 12:58:43.340319 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] Returning 404 to user: Instance 746985f5-95e3-4ad2-a997-67653768dfd3 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 12:58:43.340319 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-530d5c54-179a-44ab-8af0-3266229a1d52 tempest-AttachVolumeNegativeTest-2043746257 tempest-AttachVolumeNegativeTest-2043746257-project] 10.222.0.15 "GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3" status: 404 len: 111 microversion: 2.1 time: 0.030204 Aug 22 12:58:43.340820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 489/976] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 12:58:43 2022] GET /compute/v2.1/servers/746985f5-95e3-4ad2-a997-67653768dfd3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 13:00:00.718810 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-55710249-bef9-4f3f-aacd-6de546ea794c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:00.719389 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-55710249-bef9-4f3f-aacd-6de546ea794c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:00.725520 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:00.726304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:00.728086 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55710249-bef9-4f3f-aacd-6de546ea794c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:00.729050 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55710249-bef9-4f3f-aacd-6de546ea794c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:00.729656 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55710249-bef9-4f3f-aacd-6de546ea794c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:00.730580 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55710249-bef9-4f3f-aacd-6de546ea794c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:00.731204 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55710249-bef9-4f3f-aacd-6de546ea794c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:00.731817 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-55710249-bef9-4f3f-aacd-6de546ea794c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:00.756085 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-55710249-bef9-4f3f-aacd-6de546ea794c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lazy-loading 'flavor' on Instance uuid b4b42279-7db6-4c28-8557-014f54e9afef {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 13:00:01.047670 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-55710249-bef9-4f3f-aacd-6de546ea794c tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "POST /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef/action" status: 202 len: 0 microversion: 2.1 time: 0.333194 Aug 22 13:00:01.048595 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 488/977] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 13:00:00 2022] POST /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 13:00:01.056862 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:01.059863 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:01.063264 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d6dcde16-beb0-4993-a758-d7e72e912b06 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:01.064081 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d6dcde16-beb0-4993-a758-d7e72e912b06 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:01.071043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d6dcde16-beb0-4993-a758-d7e72e912b06 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:01.071796 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d6dcde16-beb0-4993-a758-d7e72e912b06 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:01.072287 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d6dcde16-beb0-4993-a758-d7e72e912b06 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:01.073169 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d6dcde16-beb0-4993-a758-d7e72e912b06 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:01.073626 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d6dcde16-beb0-4993-a758-d7e72e912b06 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:01.074049 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d6dcde16-beb0-4993-a758-d7e72e912b06 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:01.219092 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d6dcde16-beb0-4993-a758-d7e72e912b06 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:01.243641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d6dcde16-beb0-4993-a758-d7e72e912b06 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.176168 Aug 22 13:00:01.243641 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 490/978] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:01 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:02.260587 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b23fea91-3932-4d48-b9b2-1b03730f8956 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:02.266149 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b23fea91-3932-4d48-b9b2-1b03730f8956 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:02.274939 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b23fea91-3932-4d48-b9b2-1b03730f8956 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:02.275879 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b23fea91-3932-4d48-b9b2-1b03730f8956 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:02.276861 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b23fea91-3932-4d48-b9b2-1b03730f8956 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:02.278231 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b23fea91-3932-4d48-b9b2-1b03730f8956 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:02.278965 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b23fea91-3932-4d48-b9b2-1b03730f8956 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:02.279628 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b23fea91-3932-4d48-b9b2-1b03730f8956 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:02.458915 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b23fea91-3932-4d48-b9b2-1b03730f8956 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:02.468750 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b23fea91-3932-4d48-b9b2-1b03730f8956 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.216497 Aug 22 13:00:02.469899 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 489/979] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:02 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:03.493812 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2a26de03-c0cc-473e-bfb6-ad9a5fd92ede tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:03.495804 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2a26de03-c0cc-473e-bfb6-ad9a5fd92ede tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:03.516439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a26de03-c0cc-473e-bfb6-ad9a5fd92ede tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:03.517707 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a26de03-c0cc-473e-bfb6-ad9a5fd92ede tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:03.518582 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a26de03-c0cc-473e-bfb6-ad9a5fd92ede tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:03.520645 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a26de03-c0cc-473e-bfb6-ad9a5fd92ede tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:03.521515 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a26de03-c0cc-473e-bfb6-ad9a5fd92ede tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:03.522209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a26de03-c0cc-473e-bfb6-ad9a5fd92ede tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:03.701185 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2a26de03-c0cc-473e-bfb6-ad9a5fd92ede tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:03.709768 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2a26de03-c0cc-473e-bfb6-ad9a5fd92ede tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.222531 Aug 22 13:00:03.710608 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 491/980] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:03 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:04.734278 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-304ba46c-7f93-4193-bd13-94cc014afd27 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:04.735576 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-304ba46c-7f93-4193-bd13-94cc014afd27 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:04.744925 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304ba46c-7f93-4193-bd13-94cc014afd27 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:04.745718 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304ba46c-7f93-4193-bd13-94cc014afd27 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:04.746855 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304ba46c-7f93-4193-bd13-94cc014afd27 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:04.748080 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304ba46c-7f93-4193-bd13-94cc014afd27 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:04.748557 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304ba46c-7f93-4193-bd13-94cc014afd27 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:04.748988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-304ba46c-7f93-4193-bd13-94cc014afd27 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:04.905628 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-304ba46c-7f93-4193-bd13-94cc014afd27 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:04.915597 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-304ba46c-7f93-4193-bd13-94cc014afd27 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.186799 Aug 22 13:00:04.917406 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 490/981] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:04 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:05.938513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4e4d9275-79d4-4f16-bfab-95c79b256bbb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:05.944324 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4e4d9275-79d4-4f16-bfab-95c79b256bbb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:05.949377 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e4d9275-79d4-4f16-bfab-95c79b256bbb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:05.949949 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e4d9275-79d4-4f16-bfab-95c79b256bbb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:05.950514 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e4d9275-79d4-4f16-bfab-95c79b256bbb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:05.951519 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e4d9275-79d4-4f16-bfab-95c79b256bbb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:05.952193 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e4d9275-79d4-4f16-bfab-95c79b256bbb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:05.952923 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4e4d9275-79d4-4f16-bfab-95c79b256bbb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:06.113063 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-4e4d9275-79d4-4f16-bfab-95c79b256bbb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:06.130374 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4e4d9275-79d4-4f16-bfab-95c79b256bbb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.196687 Aug 22 13:00:06.133336 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 492/982] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:05 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:07.158082 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-392a4e1e-ff34-4e5d-bab8-a7d3cbdd30a4 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:07.159382 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-392a4e1e-ff34-4e5d-bab8-a7d3cbdd30a4 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:07.171057 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-392a4e1e-ff34-4e5d-bab8-a7d3cbdd30a4 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:07.172215 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-392a4e1e-ff34-4e5d-bab8-a7d3cbdd30a4 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:07.172660 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-392a4e1e-ff34-4e5d-bab8-a7d3cbdd30a4 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:07.173381 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-392a4e1e-ff34-4e5d-bab8-a7d3cbdd30a4 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:07.173845 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-392a4e1e-ff34-4e5d-bab8-a7d3cbdd30a4 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:07.174297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-392a4e1e-ff34-4e5d-bab8-a7d3cbdd30a4 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:07.209708 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1920046624", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1880130090", "security_groups": [{"name": "tempest-secgroup-smoke-2114417346"}], "block_device_mapping_v2": [{"uuid": "2b7b1a78-c59e-4c8a-a00b-5060a9d72767", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f69688de-f377-4c85-a58c-b5ac46ea4c35"}]}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:07.439619 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.network.neutron [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] validate_networks() for [('f69688de-f377-4c85-a58c-b5ac46ea4c35', None, None, None, None, None)] {{(pid=127810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 13:00:07.458963 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-392a4e1e-ff34-4e5d-bab8-a7d3cbdd30a4 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:07.471211 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-392a4e1e-ff34-4e5d-bab8-a7d3cbdd30a4 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.316854 Aug 22 13:00:07.472470 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 491/983] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:07 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:08.189363 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Flavor limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 13:00:08.190137 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Image limits 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 13:00:08.190709 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Flavor pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 13:00:08.191363 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Image pref 0:0:0 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 13:00:08.193033 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.virt.hardware [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 13:00:08.205975 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:08.206799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:08.207484 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:08.208406 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:08.209490 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:08.210573 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:08.235276 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Getting quotas for project 66ab7e2f4bbd43f4a795a5f1068a32f9. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 13:00:08.246884 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.quota [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Getting quotas for user 35306cf75bde4fdcbb1374fa9ab82aa7 and project 66ab7e2f4bbd43f4a795a5f1068a32f9. Resources: {'ram', 'instances', 'cores'} {{(pid=127810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 13:00:08.380656 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Going to run 1 instances... {{(pid=127810) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 13:00:08.385897 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b7b1a78-c59e-4c8a-a00b-5060a9d72767',volume_size=None,volume_type=None)] {{(pid=127810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 13:00:08.496146 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3c8eb248-8e12-443b-b7ff-bd70094c0ba1 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:08.496763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-3c8eb248-8e12-443b-b7ff-bd70094c0ba1 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:08.508327 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3c8eb248-8e12-443b-b7ff-bd70094c0ba1 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:08.511809 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3c8eb248-8e12-443b-b7ff-bd70094c0ba1 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:08.515054 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3c8eb248-8e12-443b-b7ff-bd70094c0ba1 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:08.515054 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3c8eb248-8e12-443b-b7ff-bd70094c0ba1 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:08.515054 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3c8eb248-8e12-443b-b7ff-bd70094c0ba1 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:08.515054 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-3c8eb248-8e12-443b-b7ff-bd70094c0ba1 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:08.792023 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3c8eb248-8e12-443b-b7ff-bd70094c0ba1 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:08.802595 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-3c8eb248-8e12-443b-b7ff-bd70094c0ba1 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.310760 Aug 22 13:00:08.804556 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 492/984] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:08 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:08.862312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR oslo.messaging._drivers.impl_rabbit [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [3a1ebbc7-e096-4251-be66-7c6f6b518c2a] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 13:00:09.824891 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d5ea3ae9-fe23-4b6c-bdbd-de09cb965356 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:09.825804 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-d5ea3ae9-fe23-4b6c-bdbd-de09cb965356 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:09.833988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5ea3ae9-fe23-4b6c-bdbd-de09cb965356 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:09.834514 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5ea3ae9-fe23-4b6c-bdbd-de09cb965356 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:09.834966 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5ea3ae9-fe23-4b6c-bdbd-de09cb965356 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:09.835834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5ea3ae9-fe23-4b6c-bdbd-de09cb965356 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:09.836550 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5ea3ae9-fe23-4b6c-bdbd-de09cb965356 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:09.837349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d5ea3ae9-fe23-4b6c-bdbd-de09cb965356 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:09.870391 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO oslo.messaging._drivers.impl_rabbit [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [3a1ebbc7-e096-4251-be66-7c6f6b518c2a] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 33922. Aug 22 13:00:09.875438 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-37458c67-f6b1-4e28-b04b-bb8dfb70ee15 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.670310 Aug 22 13:00:09.876593 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 493/985] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 13:00:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 2672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 13:00:09.886895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-50109cf0-d2c5-4009-a463-259f876513bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:09.887850 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-50109cf0-d2c5-4009-a463-259f876513bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:09.959895 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-50109cf0-d2c5-4009-a463-259f876513bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:09.968650 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-50109cf0-d2c5-4009-a463-259f876513bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1095 microversion: 2.1 time: 0.085311 Aug 22 13:00:09.972898 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 494/986] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:09 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1095 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:10.042505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d5ea3ae9-fe23-4b6c-bdbd-de09cb965356 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:10.051134 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d5ea3ae9-fe23-4b6c-bdbd-de09cb965356 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.229939 Aug 22 13:00:10.051710 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 493/987] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:09 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:00:10.993348 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b9d8ef45-a449-4eee-953a-391b3c198196 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:10.993908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b9d8ef45-a449-4eee-953a-391b3c198196 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:11.057971 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b9d8ef45-a449-4eee-953a-391b3c198196 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:11.065886 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b9d8ef45-a449-4eee-953a-391b3c198196 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1095 microversion: 2.1 time: 0.076856 Aug 22 13:00:11.067611 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 495/988] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:10 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:11.072990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ac6930ad-da43-43c8-a8a1-73f0d210e0da tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:11.073610 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ac6930ad-da43-43c8-a8a1-73f0d210e0da tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:11.080109 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ac6930ad-da43-43c8-a8a1-73f0d210e0da tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:11.080804 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ac6930ad-da43-43c8-a8a1-73f0d210e0da tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:11.081286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ac6930ad-da43-43c8-a8a1-73f0d210e0da tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:11.081988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ac6930ad-da43-43c8-a8a1-73f0d210e0da tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:11.083164 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ac6930ad-da43-43c8-a8a1-73f0d210e0da tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:11.083826 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ac6930ad-da43-43c8-a8a1-73f0d210e0da tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:11.247512 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ac6930ad-da43-43c8-a8a1-73f0d210e0da tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:11.256885 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ac6930ad-da43-43c8-a8a1-73f0d210e0da tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.187734 Aug 22 13:00:11.257797 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 494/989] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:11 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:12.087548 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-92c3ad93-e1be-4b68-bb9d-1f18500892ed tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:12.088161 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-92c3ad93-e1be-4b68-bb9d-1f18500892ed tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:12.144284 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-92c3ad93-e1be-4b68-bb9d-1f18500892ed tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:12.151517 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-92c3ad93-e1be-4b68-bb9d-1f18500892ed tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1095 microversion: 2.1 time: 0.068487 Aug 22 13:00:12.152072 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 496/990] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:12 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:12.277459 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-c84fa48e-4e96-4942-8966-06fb703c0900 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:12.278104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-c84fa48e-4e96-4942-8966-06fb703c0900 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:12.284853 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c84fa48e-4e96-4942-8966-06fb703c0900 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:12.285969 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c84fa48e-4e96-4942-8966-06fb703c0900 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:12.286449 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c84fa48e-4e96-4942-8966-06fb703c0900 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:12.287184 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c84fa48e-4e96-4942-8966-06fb703c0900 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:12.287638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c84fa48e-4e96-4942-8966-06fb703c0900 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:12.288068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-c84fa48e-4e96-4942-8966-06fb703c0900 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:12.428353 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-c84fa48e-4e96-4942-8966-06fb703c0900 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:12.436355 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-c84fa48e-4e96-4942-8966-06fb703c0900 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.162963 Aug 22 13:00:12.436919 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 495/991] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:12 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:13.173093 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-199010b9-9309-417a-b027-a5d32edfcf25 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:13.173901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-199010b9-9309-417a-b027-a5d32edfcf25 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:13.246203 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-199010b9-9309-417a-b027-a5d32edfcf25 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:13.254841 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-199010b9-9309-417a-b027-a5d32edfcf25 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1095 microversion: 2.1 time: 0.084988 Aug 22 13:00:13.256171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 497/992] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:13 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:13.457702 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-57575e02-7321-46fb-936a-602dcceb0658 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:13.458328 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-57575e02-7321-46fb-936a-602dcceb0658 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:13.467906 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57575e02-7321-46fb-936a-602dcceb0658 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:13.468397 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57575e02-7321-46fb-936a-602dcceb0658 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:13.468835 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57575e02-7321-46fb-936a-602dcceb0658 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:13.469544 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57575e02-7321-46fb-936a-602dcceb0658 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:13.470001 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57575e02-7321-46fb-936a-602dcceb0658 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:13.470463 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-57575e02-7321-46fb-936a-602dcceb0658 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:13.676589 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-57575e02-7321-46fb-936a-602dcceb0658 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:13.696802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-57575e02-7321-46fb-936a-602dcceb0658 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.243119 Aug 22 13:00:13.708916 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 496/993] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:13 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:00:14.279129 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-5b1f362d-8ece-4610-8d88-b5e8d3d63dd2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:14.280009 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-5b1f362d-8ece-4610-8d88-b5e8d3d63dd2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:14.288615 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b1f362d-8ece-4610-8d88-b5e8d3d63dd2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:14.289735 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b1f362d-8ece-4610-8d88-b5e8d3d63dd2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:14.291246 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b1f362d-8ece-4610-8d88-b5e8d3d63dd2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:14.292762 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b1f362d-8ece-4610-8d88-b5e8d3d63dd2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:14.293528 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b1f362d-8ece-4610-8d88-b5e8d3d63dd2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:14.294156 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-5b1f362d-8ece-4610-8d88-b5e8d3d63dd2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:14.365320 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-5b1f362d-8ece-4610-8d88-b5e8d3d63dd2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:14.374264 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-5b1f362d-8ece-4610-8d88-b5e8d3d63dd2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1145 microversion: 2.1 time: 0.101186 Aug 22 13:00:14.375306 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 498/994] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:14 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1145 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:14.720972 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-83e2cdce-c74d-4d3d-b0a8-016000d7a6b2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:14.723524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-83e2cdce-c74d-4d3d-b0a8-016000d7a6b2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:14.732196 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83e2cdce-c74d-4d3d-b0a8-016000d7a6b2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:14.733182 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83e2cdce-c74d-4d3d-b0a8-016000d7a6b2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:14.733701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83e2cdce-c74d-4d3d-b0a8-016000d7a6b2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:14.734445 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83e2cdce-c74d-4d3d-b0a8-016000d7a6b2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:14.734934 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83e2cdce-c74d-4d3d-b0a8-016000d7a6b2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:14.735555 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-83e2cdce-c74d-4d3d-b0a8-016000d7a6b2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:14.918160 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-83e2cdce-c74d-4d3d-b0a8-016000d7a6b2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:14.950594 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-83e2cdce-c74d-4d3d-b0a8-016000d7a6b2 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.233405 Aug 22 13:00:14.951241 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 497/995] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:14 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:15.525313 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-fdd61276-9268-4fa7-9d18-79c20a10b433 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:15.525313 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-fdd61276-9268-4fa7-9d18-79c20a10b433 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:15.525313 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd61276-9268-4fa7-9d18-79c20a10b433 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:15.525313 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd61276-9268-4fa7-9d18-79c20a10b433 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:15.526904 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd61276-9268-4fa7-9d18-79c20a10b433 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:15.526904 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd61276-9268-4fa7-9d18-79c20a10b433 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:15.526904 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd61276-9268-4fa7-9d18-79c20a10b433 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:15.526904 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd61276-9268-4fa7-9d18-79c20a10b433 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:15.527247 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-fdd61276-9268-4fa7-9d18-79c20a10b433 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:15.527247 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-fdd61276-9268-4fa7-9d18-79c20a10b433 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1145 microversion: 2.1 time: 0.086623 Aug 22 13:00:15.527247 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 499/996] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:15 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:15.973400 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d2131faf-5374-4543-a511-5d8b3a639437 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:15.974137 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-d2131faf-5374-4543-a511-5d8b3a639437 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:15.980815 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d2131faf-5374-4543-a511-5d8b3a639437 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:15.981708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d2131faf-5374-4543-a511-5d8b3a639437 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:15.982398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d2131faf-5374-4543-a511-5d8b3a639437 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:15.983590 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d2131faf-5374-4543-a511-5d8b3a639437 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:15.984289 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d2131faf-5374-4543-a511-5d8b3a639437 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:15.984924 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d2131faf-5374-4543-a511-5d8b3a639437 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:16.127299 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d2131faf-5374-4543-a511-5d8b3a639437 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:16.144653 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d2131faf-5374-4543-a511-5d8b3a639437 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1509 microversion: 2.1 time: 0.170213 Aug 22 13:00:16.145660 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 498/997] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:15 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:16.166980 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8df31993-b1fd-4f18-9795-ca99c2c9be49 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:16.167891 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8df31993-b1fd-4f18-9795-ca99c2c9be49 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:16.174924 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8df31993-b1fd-4f18-9795-ca99c2c9be49 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:16.175454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8df31993-b1fd-4f18-9795-ca99c2c9be49 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:16.175922 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8df31993-b1fd-4f18-9795-ca99c2c9be49 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:16.177170 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8df31993-b1fd-4f18-9795-ca99c2c9be49 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:16.177629 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8df31993-b1fd-4f18-9795-ca99c2c9be49 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:16.178058 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8df31993-b1fd-4f18-9795-ca99c2c9be49 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:16.221335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8df31993-b1fd-4f18-9795-ca99c2c9be49 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127810) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 13:00:16.500448 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-30ba73b0-bbcf-432c-8919-80c8cd528c09 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:16.501066 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-30ba73b0-bbcf-432c-8919-80c8cd528c09 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:16.502251 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8df31993-b1fd-4f18-9795-ca99c2c9be49 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "POST /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef/action" status: 202 len: 0 microversion: 2.1 time: 0.338982 Aug 22 13:00:16.506043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 500/998] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 13:00:16 2022] POST /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 13:00:16.509060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30ba73b0-bbcf-432c-8919-80c8cd528c09 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:16.509459 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30ba73b0-bbcf-432c-8919-80c8cd528c09 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:16.509889 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30ba73b0-bbcf-432c-8919-80c8cd528c09 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:16.510713 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30ba73b0-bbcf-432c-8919-80c8cd528c09 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:16.511063 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30ba73b0-bbcf-432c-8919-80c8cd528c09 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:16.511482 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-30ba73b0-bbcf-432c-8919-80c8cd528c09 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:16.511886 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f35e7268-656d-497b-8ca8-b54850a756fa tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:16.512572 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f35e7268-656d-497b-8ca8-b54850a756fa tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:16.521128 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f35e7268-656d-497b-8ca8-b54850a756fa tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:16.521712 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f35e7268-656d-497b-8ca8-b54850a756fa tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:16.522310 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f35e7268-656d-497b-8ca8-b54850a756fa tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:16.528068 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f35e7268-656d-497b-8ca8-b54850a756fa tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:16.528068 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f35e7268-656d-497b-8ca8-b54850a756fa tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:16.528068 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f35e7268-656d-497b-8ca8-b54850a756fa tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:16.617142 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-30ba73b0-bbcf-432c-8919-80c8cd528c09 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:16.624968 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-30ba73b0-bbcf-432c-8919-80c8cd528c09 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1193 microversion: 2.1 time: 0.128233 Aug 22 13:00:16.637393 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 499/999] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:16 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1193 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:00:16.637393 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-99a90b55-1ee6-4f2a-af2a-5db245d9a5d7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Action: 'create', calling method: .version_select at 0x7f7659c89b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1079357888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqqoX4Vm8JAfBcm1HpyVa3lixEDDPFk1b2P/CQAWsk0moWkhnKBQfXZKcoTngMWZBZEQt0tkhc3PLKKRevb9CuHQ0xKeGjFZYVzXjoDNMm26vA5GOzs9b0nQmnzHeNyjg=="}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:16.649376 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-99a90b55-1ee6-4f2a-af2a-5db245d9a5d7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Getting quotas for project dc8d034424a64918a43ca2b961aa2063. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 13:00:16.654507 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-99a90b55-1ee6-4f2a-af2a-5db245d9a5d7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Getting quotas for user af21f5997a3240a09dbcaab6d1580eef and project dc8d034424a64918a43ca2b961aa2063. Resources: {'key_pairs'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 13:00:16.667726 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR oslo.messaging._drivers.impl_rabbit [None req-99a90b55-1ee6-4f2a-af2a-5db245d9a5d7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [c77fc965-87e7-4fcf-af8f-15dc80df45d7] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 13:00:16.738982 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f35e7268-656d-497b-8ca8-b54850a756fa tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:16.747447 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f35e7268-656d-497b-8ca8-b54850a756fa tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1517 microversion: 2.1 time: 0.240124 Aug 22 13:00:16.748020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 501/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:16 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:17.033951 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-24f582e0-7914-481f-a7c7-5a330eea053e req-6a9fc25a-bed2-4a4e-9d00-d26e0f40b668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b42279-7db6-4c28-8557-014f54e9afef", "name": "network-vif-unplugged", "status": "completed", "tag": "9a28b39e-e983-4692-a43c-7821a73d6e5b"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:17.044413 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-24f582e0-7914-481f-a7c7-5a330eea053e req-6a9fc25a-bed2-4a4e-9d00-d26e0f40b668 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:17.046937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-24f582e0-7914-481f-a7c7-5a330eea053e req-6a9fc25a-bed2-4a4e-9d00-d26e0f40b668 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:17.046937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-24f582e0-7914-481f-a7c7-5a330eea053e req-6a9fc25a-bed2-4a4e-9d00-d26e0f40b668 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:17.057491 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.compute.server_external_events [req-24f582e0-7914-481f-a7c7-5a330eea053e req-6a9fc25a-bed2-4a4e-9d00-d26e0f40b668 service nova] Unable to find a host for instance b4b42279-7db6-4c28-8557-014f54e9afef. Dropping event network-vif-unplugged {{(pid=127810) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 22 13:00:17.058375 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-24f582e0-7914-481f-a7c7-5a330eea053e req-6a9fc25a-bed2-4a4e-9d00-d26e0f40b668 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028754 Aug 22 13:00:17.058951 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 502/1001] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 22 13:00:17.658700 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3e260638-0197-4405-b09e-f075c1dc1f48 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:17.659811 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3e260638-0197-4405-b09e-f075c1dc1f48 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:17.669213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3e260638-0197-4405-b09e-f075c1dc1f48 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:17.673182 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3e260638-0197-4405-b09e-f075c1dc1f48 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:17.673818 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3e260638-0197-4405-b09e-f075c1dc1f48 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:17.674756 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3e260638-0197-4405-b09e-f075c1dc1f48 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:17.675347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3e260638-0197-4405-b09e-f075c1dc1f48 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:17.676497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3e260638-0197-4405-b09e-f075c1dc1f48 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:17.689792 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO oslo.messaging._drivers.impl_rabbit [None req-99a90b55-1ee6-4f2a-af2a-5db245d9a5d7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [c77fc965-87e7-4fcf-af8f-15dc80df45d7] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 33992. Aug 22 13:00:17.749140 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3e260638-0197-4405-b09e-f075c1dc1f48 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:17.756983 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3e260638-0197-4405-b09e-f075c1dc1f48 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1211 microversion: 2.1 time: 0.114142 Aug 22 13:00:17.757550 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 503/1002] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:17 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:17.768987 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-9e6afb07-60aa-47d2-bbab-4fc041ec4188 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:17.770234 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-9e6afb07-60aa-47d2-bbab-4fc041ec4188 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:17.778617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9e6afb07-60aa-47d2-bbab-4fc041ec4188 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:17.779211 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9e6afb07-60aa-47d2-bbab-4fc041ec4188 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:17.779950 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9e6afb07-60aa-47d2-bbab-4fc041ec4188 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:17.780647 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9e6afb07-60aa-47d2-bbab-4fc041ec4188 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:17.781105 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9e6afb07-60aa-47d2-bbab-4fc041ec4188 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:17.781532 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9e6afb07-60aa-47d2-bbab-4fc041ec4188 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:17.807739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-99a90b55-1ee6-4f2a-af2a-5db245d9a5d7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.180768 Aug 22 13:00:17.809929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 500/1003] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 22 13:00:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:00:17.863326 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1811568449", "imageRef": "e60cb7e6-3789-4743-ac85-dda6d78768df", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1079357888", "networks": [{"uuid": "94af2917-8cb9-4251-98bb-ef2cdcecdf2f"}]}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:17.923640 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.network.neutron [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] validate_networks() for [('94af2917-8cb9-4251-98bb-ef2cdcecdf2f', None, None, None, None, None)] {{(pid=127809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 13:00:18.003439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9e6afb07-60aa-47d2-bbab-4fc041ec4188 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:18.016139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-9e6afb07-60aa-47d2-bbab-4fc041ec4188 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1517 microversion: 2.1 time: 0.249785 Aug 22 13:00:18.033137 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 504/1004] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:17 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1517 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:18.410092 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Flavor limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 13:00:18.410572 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Image limits 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 13:00:18.411651 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Flavor pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 13:00:18.412069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Image pref 0:0:0 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 13:00:18.412488 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.virt.hardware [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 13:00:18.421026 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:18.421509 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:18.421937 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:18.422688 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:18.423174 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:18.423599 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:18.440653 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Getting quotas for project dc8d034424a64918a43ca2b961aa2063. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 13:00:18.445285 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.quota [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Getting quotas for user af21f5997a3240a09dbcaab6d1580eef and project dc8d034424a64918a43ca2b961aa2063. Resources: {'ram', 'instances', 'cores'} {{(pid=127809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 13:00:18.456156 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Going to run 1 instances... {{(pid=127809) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 13:00:18.459040 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e60cb7e6-3789-4743-ac85-dda6d78768df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 13:00:18.564843 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [e1e7c698-da18-4c5b-beea-9006f9f8bea8] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 13:00:18.782867 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e9b1be43-9530-4bb4-bd25-7338c0634b5a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:18.783435 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e9b1be43-9530-4bb4-bd25-7338c0634b5a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:18.785231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=2 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:18.790741 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e9b1be43-9530-4bb4-bd25-7338c0634b5a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:18.791237 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e9b1be43-9530-4bb4-bd25-7338c0634b5a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:18.791681 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e9b1be43-9530-4bb4-bd25-7338c0634b5a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:18.792384 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e9b1be43-9530-4bb4-bd25-7338c0634b5a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:18.792847 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e9b1be43-9530-4bb4-bd25-7338c0634b5a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:18.793279 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e9b1be43-9530-4bb4-bd25-7338c0634b5a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:18.925608 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e9b1be43-9530-4bb4-bd25-7338c0634b5a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:18.935333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e9b1be43-9530-4bb4-bd25-7338c0634b5a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1279 microversion: 2.1 time: 0.156711 Aug 22 13:00:18.935908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 505/1005] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:18 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:00:18.940398 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-61831563-9d82-4ff4-88f7-968c5db2976f req-cc94e591-0b80-48f9-9a77-dfdb1b7dc075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9000846-e56b-43f8-acf7-3ef136f0b43f", "tag": "1b4b6f67-a372-4741-8462-705b349b1f43"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:18.949470 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-61831563-9d82-4ff4-88f7-968c5db2976f req-cc94e591-0b80-48f9-9a77-dfdb1b7dc075 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:18.949943 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-61831563-9d82-4ff4-88f7-968c5db2976f req-cc94e591-0b80-48f9-9a77-dfdb1b7dc075 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:18.950400 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-61831563-9d82-4ff4-88f7-968c5db2976f req-cc94e591-0b80-48f9-9a77-dfdb1b7dc075 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:18.960659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-61831563-9d82-4ff4-88f7-968c5db2976f req-cc94e591-0b80-48f9-9a77-dfdb1b7dc075 service nova] Creating event network-changed:1b4b6f67-a372-4741-8462-705b349b1f43 for instance e9000846-e56b-43f8-acf7-3ef136f0b43f on hv-cinder-85083 Aug 22 13:00:18.965807 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-61831563-9d82-4ff4-88f7-968c5db2976f req-cc94e591-0b80-48f9-9a77-dfdb1b7dc075 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028714 Aug 22 13:00:18.966465 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 506/1006] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:00:19.041257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-531bacd3-5bae-47ef-a236-6d0c236f2725 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:19.042005 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-531bacd3-5bae-47ef-a236-6d0c236f2725 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:19.048695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-531bacd3-5bae-47ef-a236-6d0c236f2725 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:19.049179 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-531bacd3-5bae-47ef-a236-6d0c236f2725 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:19.049611 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-531bacd3-5bae-47ef-a236-6d0c236f2725 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:19.050333 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-531bacd3-5bae-47ef-a236-6d0c236f2725 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:19.050826 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-531bacd3-5bae-47ef-a236-6d0c236f2725 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:19.051794 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-531bacd3-5bae-47ef-a236-6d0c236f2725 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:19.190485 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-531bacd3-5bae-47ef-a236-6d0c236f2725 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:19.207970 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-531bacd3-5bae-47ef-a236-6d0c236f2725 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1517 microversion: 2.1 time: 0.170192 Aug 22 13:00:19.208888 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 507/1007] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:19 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:00:19.573908 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO oslo.messaging._drivers.impl_rabbit [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [e1e7c698-da18-4c5b-beea-9006f9f8bea8] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 34026. Aug 22 13:00:19.578266 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f81a3ef6-1641-478d-8367-7ed83afab78d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.718663 Aug 22 13:00:19.579100 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 501/1008] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 22 13:00:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 13:00:19.589507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-430eb1d0-b232-4a70-95c6-364cc33effe2 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:19.590121 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-430eb1d0-b232-4a70-95c6-364cc33effe2 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:19.646663 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-430eb1d0-b232-4a70-95c6-364cc33effe2 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:19.653852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-430eb1d0-b232-4a70-95c6-364cc33effe2 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1259 microversion: 2.1 time: 0.068004 Aug 22 13:00:19.664663 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 508/1009] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:19 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:19.956113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-806b7eb7-46ba-4f40-83c0-fa66ed5b06b9 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:19.956664 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-806b7eb7-46ba-4f40-83c0-fa66ed5b06b9 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:19.962754 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-806b7eb7-46ba-4f40-83c0-fa66ed5b06b9 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:19.963245 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-806b7eb7-46ba-4f40-83c0-fa66ed5b06b9 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:19.963685 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-806b7eb7-46ba-4f40-83c0-fa66ed5b06b9 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:19.964383 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-806b7eb7-46ba-4f40-83c0-fa66ed5b06b9 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:19.964844 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-806b7eb7-46ba-4f40-83c0-fa66ed5b06b9 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:19.965273 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-806b7eb7-46ba-4f40-83c0-fa66ed5b06b9 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:20.094156 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-806b7eb7-46ba-4f40-83c0-fa66ed5b06b9 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:20.102505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-806b7eb7-46ba-4f40-83c0-fa66ed5b06b9 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.150616 Aug 22 13:00:20.103071 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 502/1010] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:19 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:20.229803 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ddb0307f-c5ba-4d47-8e74-065ad882ab44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:20.230396 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ddb0307f-c5ba-4d47-8e74-065ad882ab44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:20.239586 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ddb0307f-c5ba-4d47-8e74-065ad882ab44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:20.240122 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ddb0307f-c5ba-4d47-8e74-065ad882ab44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:20.240563 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ddb0307f-c5ba-4d47-8e74-065ad882ab44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:20.241265 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ddb0307f-c5ba-4d47-8e74-065ad882ab44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:20.241879 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ddb0307f-c5ba-4d47-8e74-065ad882ab44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:20.242451 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ddb0307f-c5ba-4d47-8e74-065ad882ab44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:20.376877 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ddb0307f-c5ba-4d47-8e74-065ad882ab44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:20.384857 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ddb0307f-c5ba-4d47-8e74-065ad882ab44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1517 microversion: 2.1 time: 0.159141 Aug 22 13:00:20.385418 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 509/1011] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:20 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:20.674130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-3853f451-87e6-4452-be40-1c73f673b89b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:20.674801 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-3853f451-87e6-4452-be40-1c73f673b89b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:20.727241 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-3853f451-87e6-4452-be40-1c73f673b89b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:20.734242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-3853f451-87e6-4452-be40-1c73f673b89b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1259 microversion: 2.1 time: 0.064020 Aug 22 13:00:20.734802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 503/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:20 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1259 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:21.123680 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-65948615-fefa-4896-b34a-bda71411f5da tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:21.124213 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-65948615-fefa-4896-b34a-bda71411f5da tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:21.130759 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-65948615-fefa-4896-b34a-bda71411f5da tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:21.131249 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-65948615-fefa-4896-b34a-bda71411f5da tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:21.131690 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-65948615-fefa-4896-b34a-bda71411f5da tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:21.132384 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-65948615-fefa-4896-b34a-bda71411f5da tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:21.132842 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-65948615-fefa-4896-b34a-bda71411f5da tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:21.133290 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-65948615-fefa-4896-b34a-bda71411f5da tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:21.264148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-65948615-fefa-4896-b34a-bda71411f5da tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:21.272203 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-65948615-fefa-4896-b34a-bda71411f5da tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.152454 Aug 22 13:00:21.272768 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 510/1013] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:21 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:21.406621 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-e359b3c8-bb41-41ea-a20d-16ec09e3f5c8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:21.407159 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-e359b3c8-bb41-41ea-a20d-16ec09e3f5c8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:21.414008 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e359b3c8-bb41-41ea-a20d-16ec09e3f5c8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:21.414552 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e359b3c8-bb41-41ea-a20d-16ec09e3f5c8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:21.414984 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e359b3c8-bb41-41ea-a20d-16ec09e3f5c8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:21.415674 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e359b3c8-bb41-41ea-a20d-16ec09e3f5c8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:21.416130 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e359b3c8-bb41-41ea-a20d-16ec09e3f5c8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:21.416552 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-e359b3c8-bb41-41ea-a20d-16ec09e3f5c8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:21.551146 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-e359b3c8-bb41-41ea-a20d-16ec09e3f5c8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:21.558957 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-e359b3c8-bb41-41ea-a20d-16ec09e3f5c8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1517 microversion: 2.1 time: 0.156331 Aug 22 13:00:21.559575 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 504/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:21 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:21.754970 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2a48d5e5-d09d-473d-aaef-ac6dac7d23e6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:21.755505 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2a48d5e5-d09d-473d-aaef-ac6dac7d23e6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:21.761586 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a48d5e5-d09d-473d-aaef-ac6dac7d23e6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:21.762074 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a48d5e5-d09d-473d-aaef-ac6dac7d23e6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:21.762582 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a48d5e5-d09d-473d-aaef-ac6dac7d23e6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:21.763281 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a48d5e5-d09d-473d-aaef-ac6dac7d23e6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:21.763740 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a48d5e5-d09d-473d-aaef-ac6dac7d23e6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:21.764164 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2a48d5e5-d09d-473d-aaef-ac6dac7d23e6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:21.827396 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2a48d5e5-d09d-473d-aaef-ac6dac7d23e6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:21.836171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2a48d5e5-d09d-473d-aaef-ac6dac7d23e6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1311 microversion: 2.1 time: 0.085176 Aug 22 13:00:21.836736 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 511/1015] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:21 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:22.292860 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9db1ef38-4791-40e1-b55d-786864a3d173 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:22.293477 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9db1ef38-4791-40e1-b55d-786864a3d173 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:22.299425 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9db1ef38-4791-40e1-b55d-786864a3d173 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:22.299913 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9db1ef38-4791-40e1-b55d-786864a3d173 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:22.300383 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9db1ef38-4791-40e1-b55d-786864a3d173 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:22.301069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9db1ef38-4791-40e1-b55d-786864a3d173 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:22.301528 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9db1ef38-4791-40e1-b55d-786864a3d173 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:22.302522 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9db1ef38-4791-40e1-b55d-786864a3d173 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:22.306628 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:22.464587 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-9db1ef38-4791-40e1-b55d-786864a3d173 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:22.473118 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9db1ef38-4791-40e1-b55d-786864a3d173 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.184058 Aug 22 13:00:22.474444 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 505/1016] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:22 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:22.581820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-36168436-f146-40a9-9fe3-442cb50ccb50 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:22.594075 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-36168436-f146-40a9-9fe3-442cb50ccb50 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:22.594075 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-36168436-f146-40a9-9fe3-442cb50ccb50 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:22.594075 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-36168436-f146-40a9-9fe3-442cb50ccb50 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:22.594075 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-36168436-f146-40a9-9fe3-442cb50ccb50 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:22.594716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-36168436-f146-40a9-9fe3-442cb50ccb50 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:22.594716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-36168436-f146-40a9-9fe3-442cb50ccb50 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:22.594716 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-36168436-f146-40a9-9fe3-442cb50ccb50 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:22.630863 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:22.751571 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-36168436-f146-40a9-9fe3-442cb50ccb50 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:22.759782 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-36168436-f146-40a9-9fe3-442cb50ccb50 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1519 microversion: 2.1 time: 0.182333 Aug 22 13:00:22.780193 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 512/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:22 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:22.857523 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d7551a03-6837-4509-a7d5-bf8fe3334027 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:22.858862 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-d7551a03-6837-4509-a7d5-bf8fe3334027 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:22.876916 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d7551a03-6837-4509-a7d5-bf8fe3334027 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:22.877424 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d7551a03-6837-4509-a7d5-bf8fe3334027 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:22.878291 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d7551a03-6837-4509-a7d5-bf8fe3334027 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:22.879180 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d7551a03-6837-4509-a7d5-bf8fe3334027 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:22.879652 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d7551a03-6837-4509-a7d5-bf8fe3334027 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:22.880259 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d7551a03-6837-4509-a7d5-bf8fe3334027 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:23.110325 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-d7551a03-6837-4509-a7d5-bf8fe3334027 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:23.120604 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d7551a03-6837-4509-a7d5-bf8fe3334027 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.266938 Aug 22 13:00:23.121217 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 506/1018] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:22 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:23.503140 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-630465f2-3e35-4126-a376-86bd9a49dcb3 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:23.504689 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-630465f2-3e35-4126-a376-86bd9a49dcb3 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:23.514663 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-630465f2-3e35-4126-a376-86bd9a49dcb3 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:23.515572 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-630465f2-3e35-4126-a376-86bd9a49dcb3 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:23.516612 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-630465f2-3e35-4126-a376-86bd9a49dcb3 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:23.517619 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-630465f2-3e35-4126-a376-86bd9a49dcb3 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:23.518272 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-630465f2-3e35-4126-a376-86bd9a49dcb3 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:23.519146 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-630465f2-3e35-4126-a376-86bd9a49dcb3 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:23.707457 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-630465f2-3e35-4126-a376-86bd9a49dcb3 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:23.718513 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-630465f2-3e35-4126-a376-86bd9a49dcb3 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.224971 Aug 22 13:00:23.720161 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 513/1019] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:23 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:23.794163 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-de76a160-b735-465e-857c-4261b97f3d18 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:23.794925 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-de76a160-b735-465e-857c-4261b97f3d18 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:23.804417 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de76a160-b735-465e-857c-4261b97f3d18 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:23.805797 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de76a160-b735-465e-857c-4261b97f3d18 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:23.807758 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de76a160-b735-465e-857c-4261b97f3d18 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:23.808688 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de76a160-b735-465e-857c-4261b97f3d18 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:23.810579 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de76a160-b735-465e-857c-4261b97f3d18 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:23.810936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-de76a160-b735-465e-857c-4261b97f3d18 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:23.932672 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-f5834d5b-4939-4811-80d7-61b82ea3bedd req-ac988218-cace-4250-850e-0fda453f98e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00fc1738-a379-4fdf-b711-d9a75d2293f0", "tag": "50ba2d0a-f116-405a-ac83-eb2386fa3e53"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:23.946567 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-f5834d5b-4939-4811-80d7-61b82ea3bedd req-ac988218-cace-4250-850e-0fda453f98e3 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:23.947066 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-f5834d5b-4939-4811-80d7-61b82ea3bedd req-ac988218-cace-4250-850e-0fda453f98e3 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:23.947506 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-f5834d5b-4939-4811-80d7-61b82ea3bedd req-ac988218-cace-4250-850e-0fda453f98e3 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:23.974650 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-f5834d5b-4939-4811-80d7-61b82ea3bedd req-ac988218-cace-4250-850e-0fda453f98e3 service nova] Creating event network-changed:50ba2d0a-f116-405a-ac83-eb2386fa3e53 for instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 on hv-cinder-85083 Aug 22 13:00:23.976015 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-de76a160-b735-465e-857c-4261b97f3d18 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:23.985726 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-de76a160-b735-465e-857c-4261b97f3d18 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1519 microversion: 2.1 time: 0.196123 Aug 22 13:00:23.999420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 507/1020] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:23 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:24.003493 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-f5834d5b-4939-4811-80d7-61b82ea3bedd req-ac988218-cace-4250-850e-0fda453f98e3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075373 Aug 22 13:00:24.006659 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 514/1021] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:00:24.142370 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-43e4521b-55d9-4e1f-bebe-cebd63e2996c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:24.142953 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-43e4521b-55d9-4e1f-bebe-cebd63e2996c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:24.149417 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43e4521b-55d9-4e1f-bebe-cebd63e2996c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:24.149904 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43e4521b-55d9-4e1f-bebe-cebd63e2996c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:24.150368 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43e4521b-55d9-4e1f-bebe-cebd63e2996c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:24.151064 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43e4521b-55d9-4e1f-bebe-cebd63e2996c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:24.151519 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43e4521b-55d9-4e1f-bebe-cebd63e2996c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:24.151941 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-43e4521b-55d9-4e1f-bebe-cebd63e2996c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:24.290346 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-43e4521b-55d9-4e1f-bebe-cebd63e2996c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:24.300376 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-43e4521b-55d9-4e1f-bebe-cebd63e2996c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.161976 Aug 22 13:00:24.301047 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 508/1022] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:24 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:24.743959 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-fdd6cbbb-8bbb-4ba6-8a40-ef88eb33ed6f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:24.744667 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-fdd6cbbb-8bbb-4ba6-8a40-ef88eb33ed6f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:24.751174 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd6cbbb-8bbb-4ba6-8a40-ef88eb33ed6f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:24.751696 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd6cbbb-8bbb-4ba6-8a40-ef88eb33ed6f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:24.752139 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd6cbbb-8bbb-4ba6-8a40-ef88eb33ed6f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:24.752860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd6cbbb-8bbb-4ba6-8a40-ef88eb33ed6f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:24.753420 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd6cbbb-8bbb-4ba6-8a40-ef88eb33ed6f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:24.753910 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-fdd6cbbb-8bbb-4ba6-8a40-ef88eb33ed6f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:24.897770 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-fdd6cbbb-8bbb-4ba6-8a40-ef88eb33ed6f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:24.907053 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-fdd6cbbb-8bbb-4ba6-8a40-ef88eb33ed6f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.168424 Aug 22 13:00:24.917050 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 515/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:24 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:25.009089 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-07543ff7-6631-471f-9804-1a110a73eda8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:25.010323 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-07543ff7-6631-471f-9804-1a110a73eda8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:25.016766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07543ff7-6631-471f-9804-1a110a73eda8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:25.019858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07543ff7-6631-471f-9804-1a110a73eda8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:25.019858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07543ff7-6631-471f-9804-1a110a73eda8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:25.019858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07543ff7-6631-471f-9804-1a110a73eda8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:25.019858 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07543ff7-6631-471f-9804-1a110a73eda8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:25.020236 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-07543ff7-6631-471f-9804-1a110a73eda8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:25.157548 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-07543ff7-6631-471f-9804-1a110a73eda8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:25.166657 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-07543ff7-6631-471f-9804-1a110a73eda8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1519 microversion: 2.1 time: 0.161379 Aug 22 13:00:25.167842 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 509/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:25 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:25.320861 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7ec504d9-9586-4625-8d49-e9f59a41347a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:25.321482 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7ec504d9-9586-4625-8d49-e9f59a41347a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:25.327487 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ec504d9-9586-4625-8d49-e9f59a41347a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:25.327968 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ec504d9-9586-4625-8d49-e9f59a41347a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:25.328402 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ec504d9-9586-4625-8d49-e9f59a41347a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:25.329084 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ec504d9-9586-4625-8d49-e9f59a41347a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:25.329535 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ec504d9-9586-4625-8d49-e9f59a41347a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:25.329956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7ec504d9-9586-4625-8d49-e9f59a41347a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:25.469243 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-7ec504d9-9586-4625-8d49-e9f59a41347a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:25.484374 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7ec504d9-9586-4625-8d49-e9f59a41347a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.167279 Aug 22 13:00:25.485171 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 516/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:25 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:25.930383 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6fd7cebe-ff81-4eee-9000-f2c65a9725fc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:25.931417 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6fd7cebe-ff81-4eee-9000-f2c65a9725fc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:25.937799 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6fd7cebe-ff81-4eee-9000-f2c65a9725fc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:25.938510 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6fd7cebe-ff81-4eee-9000-f2c65a9725fc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:25.938983 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6fd7cebe-ff81-4eee-9000-f2c65a9725fc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:25.939918 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6fd7cebe-ff81-4eee-9000-f2c65a9725fc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:25.940386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6fd7cebe-ff81-4eee-9000-f2c65a9725fc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:25.940814 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6fd7cebe-ff81-4eee-9000-f2c65a9725fc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:26.098533 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6fd7cebe-ff81-4eee-9000-f2c65a9725fc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:26.117529 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6fd7cebe-ff81-4eee-9000-f2c65a9725fc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.192036 Aug 22 13:00:26.118121 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 510/1026] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:25 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:26.194085 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-bd6085ec-5b14-4c43-b747-d1d076f9abbf tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:26.194937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-bd6085ec-5b14-4c43-b747-d1d076f9abbf tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:26.206849 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bd6085ec-5b14-4c43-b747-d1d076f9abbf tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:26.207470 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bd6085ec-5b14-4c43-b747-d1d076f9abbf tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:26.208518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bd6085ec-5b14-4c43-b747-d1d076f9abbf tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:26.209317 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bd6085ec-5b14-4c43-b747-d1d076f9abbf tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:26.209869 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bd6085ec-5b14-4c43-b747-d1d076f9abbf tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:26.210508 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bd6085ec-5b14-4c43-b747-d1d076f9abbf tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:26.371024 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-bd6085ec-5b14-4c43-b747-d1d076f9abbf tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:26.379011 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-bd6085ec-5b14-4c43-b747-d1d076f9abbf tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1519 microversion: 2.1 time: 0.192172 Aug 22 13:00:26.390257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 517/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:26 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:00:26.506173 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b9ed946e-7ebf-4b4a-a7df-d2a06971fcd9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:26.507187 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b9ed946e-7ebf-4b4a-a7df-d2a06971fcd9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:26.513774 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed946e-7ebf-4b4a-a7df-d2a06971fcd9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:26.514716 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed946e-7ebf-4b4a-a7df-d2a06971fcd9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:26.515226 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed946e-7ebf-4b4a-a7df-d2a06971fcd9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:26.516055 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed946e-7ebf-4b4a-a7df-d2a06971fcd9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:26.516591 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed946e-7ebf-4b4a-a7df-d2a06971fcd9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:26.517110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed946e-7ebf-4b4a-a7df-d2a06971fcd9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:26.658802 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b9ed946e-7ebf-4b4a-a7df-d2a06971fcd9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:26.666845 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b9ed946e-7ebf-4b4a-a7df-d2a06971fcd9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.165480 Aug 22 13:00:26.667608 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 511/1028] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:26 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:27.140856 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b7be6271-0734-4269-abe1-45ee7ddd6315 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:27.141580 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b7be6271-0734-4269-abe1-45ee7ddd6315 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:27.148096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b7be6271-0734-4269-abe1-45ee7ddd6315 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:27.148683 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b7be6271-0734-4269-abe1-45ee7ddd6315 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:27.149173 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b7be6271-0734-4269-abe1-45ee7ddd6315 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:27.149876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b7be6271-0734-4269-abe1-45ee7ddd6315 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:27.150368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b7be6271-0734-4269-abe1-45ee7ddd6315 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:27.150797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b7be6271-0734-4269-abe1-45ee7ddd6315 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:27.297497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b7be6271-0734-4269-abe1-45ee7ddd6315 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:27.306104 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b7be6271-0734-4269-abe1-45ee7ddd6315 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.169405 Aug 22 13:00:27.306725 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 518/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:27 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:27.401552 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-da678d2a-27b9-4721-8432-fac08d2f666e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:27.402160 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-da678d2a-27b9-4721-8432-fac08d2f666e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:27.408497 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da678d2a-27b9-4721-8432-fac08d2f666e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:27.408993 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da678d2a-27b9-4721-8432-fac08d2f666e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:27.409435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da678d2a-27b9-4721-8432-fac08d2f666e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:27.410147 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da678d2a-27b9-4721-8432-fac08d2f666e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:27.410633 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da678d2a-27b9-4721-8432-fac08d2f666e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:27.411568 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-da678d2a-27b9-4721-8432-fac08d2f666e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:27.581460 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-da678d2a-27b9-4721-8432-fac08d2f666e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:27.590077 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-da678d2a-27b9-4721-8432-fac08d2f666e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1519 microversion: 2.1 time: 0.192463 Aug 22 13:00:27.590696 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 512/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:27 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:27.687947 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-6fe7b3c0-6b82-4f73-9490-ce7509888b67 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:27.688560 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-6fe7b3c0-6b82-4f73-9490-ce7509888b67 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:27.711795 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6fe7b3c0-6b82-4f73-9490-ce7509888b67 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:27.712296 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6fe7b3c0-6b82-4f73-9490-ce7509888b67 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:27.712734 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6fe7b3c0-6b82-4f73-9490-ce7509888b67 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:27.713446 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6fe7b3c0-6b82-4f73-9490-ce7509888b67 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:27.713908 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6fe7b3c0-6b82-4f73-9490-ce7509888b67 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:27.714368 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-6fe7b3c0-6b82-4f73-9490-ce7509888b67 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:27.853218 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-6fe7b3c0-6b82-4f73-9490-ce7509888b67 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:27.863287 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-6fe7b3c0-6b82-4f73-9490-ce7509888b67 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.179168 Aug 22 13:00:27.863869 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 519/1031] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:27 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:28.327603 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-7ca3be07-ba7c-4817-aff3-244a9518b3f2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:28.328225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-7ca3be07-ba7c-4817-aff3-244a9518b3f2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:28.334392 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ca3be07-ba7c-4817-aff3-244a9518b3f2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:28.334882 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ca3be07-ba7c-4817-aff3-244a9518b3f2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:28.335315 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ca3be07-ba7c-4817-aff3-244a9518b3f2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:28.336026 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ca3be07-ba7c-4817-aff3-244a9518b3f2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:28.336481 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ca3be07-ba7c-4817-aff3-244a9518b3f2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:28.337008 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-7ca3be07-ba7c-4817-aff3-244a9518b3f2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:28.432110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:28.497678 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-7ca3be07-ba7c-4817-aff3-244a9518b3f2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:28.506112 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-7ca3be07-ba7c-4817-aff3-244a9518b3f2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.182411 Aug 22 13:00:28.509054 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 513/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:28 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:28.618486 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b561ee18-5514-45ad-a8c8-5220f2694aee tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:28.619421 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b561ee18-5514-45ad-a8c8-5220f2694aee tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:28.628844 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b561ee18-5514-45ad-a8c8-5220f2694aee tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:28.629439 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b561ee18-5514-45ad-a8c8-5220f2694aee tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:28.630649 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b561ee18-5514-45ad-a8c8-5220f2694aee tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:28.631467 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b561ee18-5514-45ad-a8c8-5220f2694aee tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:28.631934 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b561ee18-5514-45ad-a8c8-5220f2694aee tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:28.632363 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b561ee18-5514-45ad-a8c8-5220f2694aee tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:28.774548 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b561ee18-5514-45ad-a8c8-5220f2694aee tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:28.782729 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b561ee18-5514-45ad-a8c8-5220f2694aee tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1519 microversion: 2.1 time: 0.170898 Aug 22 13:00:28.783298 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 520/1033] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:28 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:28.888780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-95f1b6fb-51be-4c97-97f3-380db651635c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:28.888780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-95f1b6fb-51be-4c97-97f3-380db651635c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:28.891048 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95f1b6fb-51be-4c97-97f3-380db651635c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:28.891542 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95f1b6fb-51be-4c97-97f3-380db651635c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:28.892017 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95f1b6fb-51be-4c97-97f3-380db651635c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:28.892717 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95f1b6fb-51be-4c97-97f3-380db651635c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:28.893179 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95f1b6fb-51be-4c97-97f3-380db651635c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:28.893616 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-95f1b6fb-51be-4c97-97f3-380db651635c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:29.278620 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-95f1b6fb-51be-4c97-97f3-380db651635c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:29.294510 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-95f1b6fb-51be-4c97-97f3-380db651635c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.413677 Aug 22 13:00:29.310384 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 514/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:28 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:29.527274 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-0833af2f-38b7-4150-9a87-c2adbb33ad98 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:29.527953 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-0833af2f-38b7-4150-9a87-c2adbb33ad98 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:29.534325 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0833af2f-38b7-4150-9a87-c2adbb33ad98 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:29.534838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0833af2f-38b7-4150-9a87-c2adbb33ad98 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:29.535277 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0833af2f-38b7-4150-9a87-c2adbb33ad98 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:29.535986 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0833af2f-38b7-4150-9a87-c2adbb33ad98 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:29.536470 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0833af2f-38b7-4150-9a87-c2adbb33ad98 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:29.536893 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-0833af2f-38b7-4150-9a87-c2adbb33ad98 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:29.652973 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell0:SELECT=16 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:29.693778 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-0833af2f-38b7-4150-9a87-c2adbb33ad98 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:29.701717 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-0833af2f-38b7-4150-9a87-c2adbb33ad98 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.178366 Aug 22 13:00:29.702305 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 521/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:29 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:29.809272 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-adaa429f-e72e-41a0-8c39-69ce1ec3aad0 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:29.810539 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-adaa429f-e72e-41a0-8c39-69ce1ec3aad0 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:29.817978 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adaa429f-e72e-41a0-8c39-69ce1ec3aad0 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:29.818608 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adaa429f-e72e-41a0-8c39-69ce1ec3aad0 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:29.819068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adaa429f-e72e-41a0-8c39-69ce1ec3aad0 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:29.819760 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adaa429f-e72e-41a0-8c39-69ce1ec3aad0 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:29.820220 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adaa429f-e72e-41a0-8c39-69ce1ec3aad0 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:29.820638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-adaa429f-e72e-41a0-8c39-69ce1ec3aad0 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:29.985013 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-adaa429f-e72e-41a0-8c39-69ce1ec3aad0 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:29.994334 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-adaa429f-e72e-41a0-8c39-69ce1ec3aad0 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1519 microversion: 2.1 time: 0.193490 Aug 22 13:00:29.995095 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 515/1036] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:29 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:30.318530 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-264d25a2-6b9e-4b25-ab10-b75d389abc42 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:30.319156 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-264d25a2-6b9e-4b25-ab10-b75d389abc42 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:30.328707 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-264d25a2-6b9e-4b25-ab10-b75d389abc42 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:30.329209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-264d25a2-6b9e-4b25-ab10-b75d389abc42 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:30.329654 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-264d25a2-6b9e-4b25-ab10-b75d389abc42 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:30.330668 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-264d25a2-6b9e-4b25-ab10-b75d389abc42 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:30.331277 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-264d25a2-6b9e-4b25-ab10-b75d389abc42 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:30.331714 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-264d25a2-6b9e-4b25-ab10-b75d389abc42 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:30.468960 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-264d25a2-6b9e-4b25-ab10-b75d389abc42 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:30.477881 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-264d25a2-6b9e-4b25-ab10-b75d389abc42 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.163548 Aug 22 13:00:30.478663 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 522/1037] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:30 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:30.724398 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8e018885-3d1a-4e6f-8e2b-11c5d6866f5e tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:30.725139 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8e018885-3d1a-4e6f-8e2b-11c5d6866f5e tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:30.730624 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=12 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:30.731947 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e018885-3d1a-4e6f-8e2b-11c5d6866f5e tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:30.732430 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e018885-3d1a-4e6f-8e2b-11c5d6866f5e tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:30.733122 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e018885-3d1a-4e6f-8e2b-11c5d6866f5e tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:30.733812 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e018885-3d1a-4e6f-8e2b-11c5d6866f5e tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:30.734291 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e018885-3d1a-4e6f-8e2b-11c5d6866f5e tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:30.734719 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8e018885-3d1a-4e6f-8e2b-11c5d6866f5e tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:30.866003 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-8e018885-3d1a-4e6f-8e2b-11c5d6866f5e tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:30.873941 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8e018885-3d1a-4e6f-8e2b-11c5d6866f5e tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.154367 Aug 22 13:00:30.874540 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 516/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:30 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:31.015812 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e5c7e6da-3b12-4000-b456-d9e2f681b6fb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:31.016433 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e5c7e6da-3b12-4000-b456-d9e2f681b6fb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:31.024154 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e5c7e6da-3b12-4000-b456-d9e2f681b6fb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:31.024705 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e5c7e6da-3b12-4000-b456-d9e2f681b6fb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:31.030025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e5c7e6da-3b12-4000-b456-d9e2f681b6fb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:31.030025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e5c7e6da-3b12-4000-b456-d9e2f681b6fb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:31.030025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e5c7e6da-3b12-4000-b456-d9e2f681b6fb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:31.030025 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e5c7e6da-3b12-4000-b456-d9e2f681b6fb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:31.158064 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e5c7e6da-3b12-4000-b456-d9e2f681b6fb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:31.165748 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e5c7e6da-3b12-4000-b456-d9e2f681b6fb tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1519 microversion: 2.1 time: 0.153954 Aug 22 13:00:31.167275 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 523/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:31 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:31.501060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-67cb724f-8136-4b8c-8939-b9d2afdb0985 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:31.501673 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-67cb724f-8136-4b8c-8939-b9d2afdb0985 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:31.508232 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67cb724f-8136-4b8c-8939-b9d2afdb0985 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:31.508721 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67cb724f-8136-4b8c-8939-b9d2afdb0985 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:31.509153 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67cb724f-8136-4b8c-8939-b9d2afdb0985 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:31.510021 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67cb724f-8136-4b8c-8939-b9d2afdb0985 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:31.510512 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67cb724f-8136-4b8c-8939-b9d2afdb0985 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:31.510976 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-67cb724f-8136-4b8c-8939-b9d2afdb0985 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:31.644103 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-67cb724f-8136-4b8c-8939-b9d2afdb0985 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:31.654135 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-67cb724f-8136-4b8c-8939-b9d2afdb0985 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.156990 Aug 22 13:00:31.655433 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 517/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:31 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:31.895859 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-489174ec-519d-472f-9b59-eb1eefa4d79c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:31.897036 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-489174ec-519d-472f-9b59-eb1eefa4d79c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:31.898562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:31.904473 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-489174ec-519d-472f-9b59-eb1eefa4d79c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:31.905193 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-489174ec-519d-472f-9b59-eb1eefa4d79c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:31.905629 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-489174ec-519d-472f-9b59-eb1eefa4d79c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:31.906355 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-489174ec-519d-472f-9b59-eb1eefa4d79c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:31.906811 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-489174ec-519d-472f-9b59-eb1eefa4d79c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:31.908009 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-489174ec-519d-472f-9b59-eb1eefa4d79c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:32.048907 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-489174ec-519d-472f-9b59-eb1eefa4d79c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:32.056900 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-489174ec-519d-472f-9b59-eb1eefa4d79c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.165341 Aug 22 13:00:32.057538 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 524/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:31 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:32.186815 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2939bf6f-9736-431b-85be-0db794d3fd4e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:32.187431 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2939bf6f-9736-431b-85be-0db794d3fd4e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:32.193884 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2939bf6f-9736-431b-85be-0db794d3fd4e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:32.194479 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2939bf6f-9736-431b-85be-0db794d3fd4e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:32.194914 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2939bf6f-9736-431b-85be-0db794d3fd4e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:32.195597 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2939bf6f-9736-431b-85be-0db794d3fd4e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:32.196048 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2939bf6f-9736-431b-85be-0db794d3fd4e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:32.196492 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2939bf6f-9736-431b-85be-0db794d3fd4e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:32.362736 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2939bf6f-9736-431b-85be-0db794d3fd4e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:32.371912 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2939bf6f-9736-431b-85be-0db794d3fd4e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1575 microversion: 2.1 time: 0.188968 Aug 22 13:00:32.372668 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 518/1042] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:32 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:32.679193 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b88734ce-b68a-41a2-87d1-78896c83343d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:32.679722 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b88734ce-b68a-41a2-87d1-78896c83343d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:32.686137 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b88734ce-b68a-41a2-87d1-78896c83343d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:32.686647 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b88734ce-b68a-41a2-87d1-78896c83343d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:32.687085 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b88734ce-b68a-41a2-87d1-78896c83343d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:32.687775 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b88734ce-b68a-41a2-87d1-78896c83343d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:32.688222 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b88734ce-b68a-41a2-87d1-78896c83343d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:32.688645 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b88734ce-b68a-41a2-87d1-78896c83343d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:32.828231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b88734ce-b68a-41a2-87d1-78896c83343d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:32.835978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b88734ce-b68a-41a2-87d1-78896c83343d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.160705 Aug 22 13:00:32.836548 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 525/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:32 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:33.076900 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b2850fea-fbb5-47cb-b682-6d0a7049c913 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:33.077550 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b2850fea-fbb5-47cb-b682-6d0a7049c913 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:33.079465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:33.084179 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b2850fea-fbb5-47cb-b682-6d0a7049c913 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:33.084676 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b2850fea-fbb5-47cb-b682-6d0a7049c913 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:33.085127 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b2850fea-fbb5-47cb-b682-6d0a7049c913 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:33.085832 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b2850fea-fbb5-47cb-b682-6d0a7049c913 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:33.086325 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b2850fea-fbb5-47cb-b682-6d0a7049c913 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:33.086755 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b2850fea-fbb5-47cb-b682-6d0a7049c913 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:33.226550 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b2850fea-fbb5-47cb-b682-6d0a7049c913 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:33.234784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b2850fea-fbb5-47cb-b682-6d0a7049c913 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.161711 Aug 22 13:00:33.235363 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 519/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:33 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:33.393765 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-2e1e00fd-be7b-4acc-a4b7-80ec3101d00e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:33.394720 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-2e1e00fd-be7b-4acc-a4b7-80ec3101d00e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:33.402137 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2e1e00fd-be7b-4acc-a4b7-80ec3101d00e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:33.402781 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2e1e00fd-be7b-4acc-a4b7-80ec3101d00e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:33.403286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2e1e00fd-be7b-4acc-a4b7-80ec3101d00e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:33.404066 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2e1e00fd-be7b-4acc-a4b7-80ec3101d00e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:33.404621 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2e1e00fd-be7b-4acc-a4b7-80ec3101d00e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:33.405109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-2e1e00fd-be7b-4acc-a4b7-80ec3101d00e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:33.562879 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-2e1e00fd-be7b-4acc-a4b7-80ec3101d00e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:33.569617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-2e1e00fd-be7b-4acc-a4b7-80ec3101d00e tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1575 microversion: 2.1 time: 0.179870 Aug 22 13:00:33.570215 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 526/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:33 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:33.857090 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-f349bebf-1382-496f-87f1-c0ccfc9219bb tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:33.858236 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-f349bebf-1382-496f-87f1-c0ccfc9219bb tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:33.864165 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f349bebf-1382-496f-87f1-c0ccfc9219bb tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:33.864744 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f349bebf-1382-496f-87f1-c0ccfc9219bb tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:33.865189 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f349bebf-1382-496f-87f1-c0ccfc9219bb tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:33.866514 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f349bebf-1382-496f-87f1-c0ccfc9219bb tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:33.866980 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f349bebf-1382-496f-87f1-c0ccfc9219bb tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:33.867517 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-f349bebf-1382-496f-87f1-c0ccfc9219bb tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:33.995143 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-f349bebf-1382-496f-87f1-c0ccfc9219bb tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:34.002647 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-f349bebf-1382-496f-87f1-c0ccfc9219bb tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.149449 Aug 22 13:00:34.003216 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 520/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:33 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:34.255930 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3595c19d-5555-4b00-aeef-65585bfe15f0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:34.256634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3595c19d-5555-4b00-aeef-65585bfe15f0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:34.262675 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3595c19d-5555-4b00-aeef-65585bfe15f0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:34.263159 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3595c19d-5555-4b00-aeef-65585bfe15f0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:34.263592 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3595c19d-5555-4b00-aeef-65585bfe15f0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:34.264283 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3595c19d-5555-4b00-aeef-65585bfe15f0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:34.264736 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3595c19d-5555-4b00-aeef-65585bfe15f0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:34.265163 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3595c19d-5555-4b00-aeef-65585bfe15f0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:34.392121 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3595c19d-5555-4b00-aeef-65585bfe15f0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:34.400264 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3595c19d-5555-4b00-aeef-65585bfe15f0 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.148234 Aug 22 13:00:34.400827 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 527/1047] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:34 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:34.590341 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1e299214-77a4-453e-bd04-3d9d030d9767 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:34.590957 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1e299214-77a4-453e-bd04-3d9d030d9767 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:34.597346 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1e299214-77a4-453e-bd04-3d9d030d9767 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:34.597917 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1e299214-77a4-453e-bd04-3d9d030d9767 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:34.598390 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1e299214-77a4-453e-bd04-3d9d030d9767 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:34.599083 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1e299214-77a4-453e-bd04-3d9d030d9767 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:34.599541 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1e299214-77a4-453e-bd04-3d9d030d9767 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:34.600527 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1e299214-77a4-453e-bd04-3d9d030d9767 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:34.879761 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1e299214-77a4-453e-bd04-3d9d030d9767 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:34.883589 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=100 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:34.888081 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1e299214-77a4-453e-bd04-3d9d030d9767 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1575 microversion: 2.1 time: 0.301589 Aug 22 13:00:34.888636 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 521/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:34 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1575 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:35.023887 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-bcc8be3a-c3b7-48b1-8eab-a158594b3dbd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:35.024469 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-bcc8be3a-c3b7-48b1-8eab-a158594b3dbd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:35.030941 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcc8be3a-c3b7-48b1-8eab-a158594b3dbd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:35.031436 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcc8be3a-c3b7-48b1-8eab-a158594b3dbd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:35.031877 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcc8be3a-c3b7-48b1-8eab-a158594b3dbd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:35.032582 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcc8be3a-c3b7-48b1-8eab-a158594b3dbd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:35.033044 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcc8be3a-c3b7-48b1-8eab-a158594b3dbd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:35.033474 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-bcc8be3a-c3b7-48b1-8eab-a158594b3dbd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:35.162108 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-bcc8be3a-c3b7-48b1-8eab-a158594b3dbd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:35.170421 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-bcc8be3a-c3b7-48b1-8eab-a158594b3dbd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.150889 Aug 22 13:00:35.170992 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 528/1049] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:35 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:35.340373 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-1909e54e-e9c0-431f-949a-cf502d0114be req-195a5dba-2574-46fd-996c-9c0182559eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9000846-e56b-43f8-acf7-3ef136f0b43f", "name": "network-vif-plugged", "status": "completed", "tag": "1b4b6f67-a372-4741-8462-705b349b1f43"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:35.350798 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-1909e54e-e9c0-431f-949a-cf502d0114be req-195a5dba-2574-46fd-996c-9c0182559eb0 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:35.351284 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-1909e54e-e9c0-431f-949a-cf502d0114be req-195a5dba-2574-46fd-996c-9c0182559eb0 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:35.351716 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-1909e54e-e9c0-431f-949a-cf502d0114be req-195a5dba-2574-46fd-996c-9c0182559eb0 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:35.362876 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-1909e54e-e9c0-431f-949a-cf502d0114be req-195a5dba-2574-46fd-996c-9c0182559eb0 service nova] Creating event network-vif-plugged:1b4b6f67-a372-4741-8462-705b349b1f43 for instance e9000846-e56b-43f8-acf7-3ef136f0b43f on hv-cinder-85083 Aug 22 13:00:35.367779 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-1909e54e-e9c0-431f-949a-cf502d0114be req-195a5dba-2574-46fd-996c-9c0182559eb0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031464 Aug 22 13:00:35.368350 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 522/1050] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:00:35.420928 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3cb4ef29-be01-4e76-9a82-bbb07349d00f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:35.421550 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3cb4ef29-be01-4e76-9a82-bbb07349d00f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:35.427694 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3cb4ef29-be01-4e76-9a82-bbb07349d00f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:35.428208 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3cb4ef29-be01-4e76-9a82-bbb07349d00f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:35.429294 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3cb4ef29-be01-4e76-9a82-bbb07349d00f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:35.430013 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3cb4ef29-be01-4e76-9a82-bbb07349d00f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:35.430507 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3cb4ef29-be01-4e76-9a82-bbb07349d00f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:35.430938 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3cb4ef29-be01-4e76-9a82-bbb07349d00f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:35.566918 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3cb4ef29-be01-4e76-9a82-bbb07349d00f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:35.570914 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=100 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:35.575496 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3cb4ef29-be01-4e76-9a82-bbb07349d00f tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.158537 Aug 22 13:00:35.576067 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 529/1051] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:35 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:35.909798 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6d6f1115-99cb-43ab-8a70-9c37ea556199 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:35.910649 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6d6f1115-99cb-43ab-8a70-9c37ea556199 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:35.917119 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6d6f1115-99cb-43ab-8a70-9c37ea556199 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:35.917629 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6d6f1115-99cb-43ab-8a70-9c37ea556199 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:35.918079 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6d6f1115-99cb-43ab-8a70-9c37ea556199 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:35.918912 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6d6f1115-99cb-43ab-8a70-9c37ea556199 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:35.919374 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6d6f1115-99cb-43ab-8a70-9c37ea556199 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:35.919796 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6d6f1115-99cb-43ab-8a70-9c37ea556199 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:36.049073 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6d6f1115-99cb-43ab-8a70-9c37ea556199 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:36.057271 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6d6f1115-99cb-43ab-8a70-9c37ea556199 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1575 microversion: 2.1 time: 0.152160 Aug 22 13:00:36.057834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 523/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:35 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:36.190946 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-69cad531-2f8d-4a84-85c9-ee3b80f79113 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:36.191560 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-69cad531-2f8d-4a84-85c9-ee3b80f79113 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:36.198208 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69cad531-2f8d-4a84-85c9-ee3b80f79113 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:36.198705 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69cad531-2f8d-4a84-85c9-ee3b80f79113 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:36.199140 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69cad531-2f8d-4a84-85c9-ee3b80f79113 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:36.199827 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69cad531-2f8d-4a84-85c9-ee3b80f79113 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:36.200284 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69cad531-2f8d-4a84-85c9-ee3b80f79113 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:36.200709 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-69cad531-2f8d-4a84-85c9-ee3b80f79113 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:36.330800 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-69cad531-2f8d-4a84-85c9-ee3b80f79113 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:36.338407 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-69cad531-2f8d-4a84-85c9-ee3b80f79113 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.151216 Aug 22 13:00:36.338973 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 530/1053] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:36 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:36.596516 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b1a3dc76-cea5-4de0-a463-b7a2438d6e8b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:36.597161 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b1a3dc76-cea5-4de0-a463-b7a2438d6e8b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:36.603801 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1a3dc76-cea5-4de0-a463-b7a2438d6e8b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:36.604299 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1a3dc76-cea5-4de0-a463-b7a2438d6e8b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:36.604743 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1a3dc76-cea5-4de0-a463-b7a2438d6e8b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:36.605437 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1a3dc76-cea5-4de0-a463-b7a2438d6e8b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:36.605901 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1a3dc76-cea5-4de0-a463-b7a2438d6e8b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:36.606369 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b1a3dc76-cea5-4de0-a463-b7a2438d6e8b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:36.735186 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b1a3dc76-cea5-4de0-a463-b7a2438d6e8b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:36.742663 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b1a3dc76-cea5-4de0-a463-b7a2438d6e8b tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1267 microversion: 2.1 time: 0.149981 Aug 22 13:00:36.743220 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 524/1054] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:36 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:37.078519 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f5711517-4e60-401d-b1d5-6eaff0d1cac8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:37.079138 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f5711517-4e60-401d-b1d5-6eaff0d1cac8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:37.085629 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f5711517-4e60-401d-b1d5-6eaff0d1cac8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:37.086113 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f5711517-4e60-401d-b1d5-6eaff0d1cac8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:37.086576 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f5711517-4e60-401d-b1d5-6eaff0d1cac8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:37.087265 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f5711517-4e60-401d-b1d5-6eaff0d1cac8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:37.087722 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f5711517-4e60-401d-b1d5-6eaff0d1cac8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:37.088165 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f5711517-4e60-401d-b1d5-6eaff0d1cac8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:37.218113 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-f5711517-4e60-401d-b1d5-6eaff0d1cac8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:37.226553 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f5711517-4e60-401d-b1d5-6eaff0d1cac8 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1575 microversion: 2.1 time: 0.151916 Aug 22 13:00:37.227354 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 531/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:37 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:00:37.359299 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-35c2f029-f445-48d4-abe3-f12277a2e6dd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:37.359926 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-35c2f029-f445-48d4-abe3-f12277a2e6dd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:37.366980 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35c2f029-f445-48d4-abe3-f12277a2e6dd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:37.367475 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35c2f029-f445-48d4-abe3-f12277a2e6dd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:37.367949 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35c2f029-f445-48d4-abe3-f12277a2e6dd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:37.368649 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35c2f029-f445-48d4-abe3-f12277a2e6dd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:37.369152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35c2f029-f445-48d4-abe3-f12277a2e6dd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:37.369585 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-35c2f029-f445-48d4-abe3-f12277a2e6dd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:37.404172 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-7540ce22-f3b1-491c-8cf5-e5e77f1d03c1 req-668e1729-d01f-4d02-acb9-d838fb0f6315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00fc1738-a379-4fdf-b711-d9a75d2293f0", "name": "network-vif-plugged", "status": "completed", "tag": "50ba2d0a-f116-405a-ac83-eb2386fa3e53"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:37.414032 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-7540ce22-f3b1-491c-8cf5-e5e77f1d03c1 req-668e1729-d01f-4d02-acb9-d838fb0f6315 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:37.414543 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-7540ce22-f3b1-491c-8cf5-e5e77f1d03c1 req-668e1729-d01f-4d02-acb9-d838fb0f6315 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:37.414980 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-7540ce22-f3b1-491c-8cf5-e5e77f1d03c1 req-668e1729-d01f-4d02-acb9-d838fb0f6315 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:37.426825 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-7540ce22-f3b1-491c-8cf5-e5e77f1d03c1 req-668e1729-d01f-4d02-acb9-d838fb0f6315 service nova] Creating event network-vif-plugged:50ba2d0a-f116-405a-ac83-eb2386fa3e53 for instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 on hv-cinder-85083 Aug 22 13:00:37.432749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-7540ce22-f3b1-491c-8cf5-e5e77f1d03c1 req-668e1729-d01f-4d02-acb9-d838fb0f6315 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032309 Aug 22 13:00:37.433515 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 532/1056] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 13:00:37.508539 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-35c2f029-f445-48d4-abe3-f12277a2e6dd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:37.517254 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-35c2f029-f445-48d4-abe3-f12277a2e6dd tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.162152 Aug 22 13:00:37.517833 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 525/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:37 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:37.763126 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-18bf5a3e-04a7-4bf7-b633-57a3e7eb41ee tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:37.763740 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-18bf5a3e-04a7-4bf7-b633-57a3e7eb41ee tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:37.769839 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18bf5a3e-04a7-4bf7-b633-57a3e7eb41ee tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:37.770358 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18bf5a3e-04a7-4bf7-b633-57a3e7eb41ee tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:37.770798 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18bf5a3e-04a7-4bf7-b633-57a3e7eb41ee tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:37.771504 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18bf5a3e-04a7-4bf7-b633-57a3e7eb41ee tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:37.771960 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18bf5a3e-04a7-4bf7-b633-57a3e7eb41ee tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:37.772391 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-18bf5a3e-04a7-4bf7-b633-57a3e7eb41ee tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:37.904473 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-18bf5a3e-04a7-4bf7-b633-57a3e7eb41ee tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:37.912702 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-18bf5a3e-04a7-4bf7-b633-57a3e7eb41ee tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1455 microversion: 2.1 time: 0.153434 Aug 22 13:00:37.913271 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 533/1058] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:37 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:37.932991 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-1b1fc7ca-5ddf-4370-bdb1-b830219ed190 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:37.933632 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-1b1fc7ca-5ddf-4370-bdb1-b830219ed190 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:37.939539 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1fc7ca-5ddf-4370-bdb1-b830219ed190 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:37.940020 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1fc7ca-5ddf-4370-bdb1-b830219ed190 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:37.940451 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1fc7ca-5ddf-4370-bdb1-b830219ed190 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:37.941134 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1fc7ca-5ddf-4370-bdb1-b830219ed190 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:37.941586 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1fc7ca-5ddf-4370-bdb1-b830219ed190 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:37.942001 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-1b1fc7ca-5ddf-4370-bdb1-b830219ed190 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:38.072609 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-1b1fc7ca-5ddf-4370-bdb1-b830219ed190 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:38.080205 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-1b1fc7ca-5ddf-4370-bdb1-b830219ed190 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1455 microversion: 2.1 time: 0.151024 Aug 22 13:00:38.080761 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 526/1059] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:37 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:38.248926 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-836d44c5-c6d0-48b1-ac85-31993248b530 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:38.249543 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-836d44c5-c6d0-48b1-ac85-31993248b530 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:38.255888 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-836d44c5-c6d0-48b1-ac85-31993248b530 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:38.256374 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-836d44c5-c6d0-48b1-ac85-31993248b530 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:38.256816 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-836d44c5-c6d0-48b1-ac85-31993248b530 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:38.257518 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-836d44c5-c6d0-48b1-ac85-31993248b530 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:38.257978 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-836d44c5-c6d0-48b1-ac85-31993248b530 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:38.258435 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-836d44c5-c6d0-48b1-ac85-31993248b530 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:38.481669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-836d44c5-c6d0-48b1-ac85-31993248b530 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:38.489694 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-836d44c5-c6d0-48b1-ac85-31993248b530 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1575 microversion: 2.1 time: 0.244736 Aug 22 13:00:38.490285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 534/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:38 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:38.537977 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bd8d2f93-624d-4874-a8dd-26f25f5e3075 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:38.538730 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bd8d2f93-624d-4874-a8dd-26f25f5e3075 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:38.545427 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8d2f93-624d-4874-a8dd-26f25f5e3075 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:38.545839 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8d2f93-624d-4874-a8dd-26f25f5e3075 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:38.546298 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8d2f93-624d-4874-a8dd-26f25f5e3075 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:38.546990 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8d2f93-624d-4874-a8dd-26f25f5e3075 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:38.547441 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8d2f93-624d-4874-a8dd-26f25f5e3075 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:38.547860 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bd8d2f93-624d-4874-a8dd-26f25f5e3075 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:38.718034 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bd8d2f93-624d-4874-a8dd-26f25f5e3075 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:38.725748 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bd8d2f93-624d-4874-a8dd-26f25f5e3075 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1359 microversion: 2.1 time: 0.191626 Aug 22 13:00:38.726325 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 527/1061] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:38 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:39.511087 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b0a2de53-6b84-41b5-9a30-dce576ff47db tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:39.511844 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b0a2de53-6b84-41b5-9a30-dce576ff47db tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:39.518295 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0a2de53-6b84-41b5-9a30-dce576ff47db tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:39.518783 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0a2de53-6b84-41b5-9a30-dce576ff47db tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:39.519220 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0a2de53-6b84-41b5-9a30-dce576ff47db tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:39.519912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0a2de53-6b84-41b5-9a30-dce576ff47db tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:39.520370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0a2de53-6b84-41b5-9a30-dce576ff47db tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:39.520791 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b0a2de53-6b84-41b5-9a30-dce576ff47db tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:39.749192 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a14aa413-2a70-46e1-9832-3b5ae9aeddb3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:39.750094 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a14aa413-2a70-46e1-9832-3b5ae9aeddb3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:39.755776 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b0a2de53-6b84-41b5-9a30-dce576ff47db tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:39.757386 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a14aa413-2a70-46e1-9832-3b5ae9aeddb3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:39.757866 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a14aa413-2a70-46e1-9832-3b5ae9aeddb3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:39.758325 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a14aa413-2a70-46e1-9832-3b5ae9aeddb3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:39.759019 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a14aa413-2a70-46e1-9832-3b5ae9aeddb3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:39.759586 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a14aa413-2a70-46e1-9832-3b5ae9aeddb3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:39.759885 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a14aa413-2a70-46e1-9832-3b5ae9aeddb3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:39.767773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b0a2de53-6b84-41b5-9a30-dce576ff47db tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1575 microversion: 2.1 time: 0.260577 Aug 22 13:00:39.768566 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 535/1062] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:39 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1575 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:40.006293 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-a14aa413-2a70-46e1-9832-3b5ae9aeddb3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:40.014144 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a14aa413-2a70-46e1-9832-3b5ae9aeddb3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1548 microversion: 2.1 time: 0.270965 Aug 22 13:00:40.014739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 528/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:39 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1548 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:40.035751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-42b71a00-dd5d-46c6-8988-d4426273e0a4 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:40.036366 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-42b71a00-dd5d-46c6-8988-d4426273e0a4 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:40.042937 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42b71a00-dd5d-46c6-8988-d4426273e0a4 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:40.043435 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42b71a00-dd5d-46c6-8988-d4426273e0a4 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:40.044972 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42b71a00-dd5d-46c6-8988-d4426273e0a4 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:40.044972 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42b71a00-dd5d-46c6-8988-d4426273e0a4 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:40.044972 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42b71a00-dd5d-46c6-8988-d4426273e0a4 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:40.045409 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-42b71a00-dd5d-46c6-8988-d4426273e0a4 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:40.453899 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-42b71a00-dd5d-46c6-8988-d4426273e0a4 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:40.462257 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-42b71a00-dd5d-46c6-8988-d4426273e0a4 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1548 microversion: 2.1 time: 0.431242 Aug 22 13:00:40.462877 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 536/1064] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:40 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1548 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:00:40.482443 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-627cbe3b-9394-4438-a37f-39b39929d927 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:40.487460 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-627cbe3b-9394-4438-a37f-39b39929d927 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:40.488223 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-627cbe3b-9394-4438-a37f-39b39929d927 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Searching by: {'deleted': False, 'project_id': 'dc8d034424a64918a43ca2b961aa2063'} {{(pid=127809) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 13:00:40.494902 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-627cbe3b-9394-4438-a37f-39b39929d927 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:40.495385 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-627cbe3b-9394-4438-a37f-39b39929d927 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:40.495823 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-627cbe3b-9394-4438-a37f-39b39929d927 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:40.496555 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-627cbe3b-9394-4438-a37f-39b39929d927 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:40.497014 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-627cbe3b-9394-4438-a37f-39b39929d927 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:40.497477 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-627cbe3b-9394-4438-a37f-39b39929d927 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:40.571023 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-bec6e056-e35e-4eda-b3c4-bf21379c7757 req-40103493-dee5-46a9-8ff2-0cf6e843f730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9000846-e56b-43f8-acf7-3ef136f0b43f", "tag": "1b4b6f67-a372-4741-8462-705b349b1f43"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:40.581892 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-bec6e056-e35e-4eda-b3c4-bf21379c7757 req-40103493-dee5-46a9-8ff2-0cf6e843f730 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:40.582479 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-bec6e056-e35e-4eda-b3c4-bf21379c7757 req-40103493-dee5-46a9-8ff2-0cf6e843f730 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:40.582981 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-bec6e056-e35e-4eda-b3c4-bf21379c7757 req-40103493-dee5-46a9-8ff2-0cf6e843f730 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:40.591974 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.multi_cell_list [None req-627cbe3b-9394-4438-a37f-39b39929d927 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127809) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 13:00:40.595512 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-bec6e056-e35e-4eda-b3c4-bf21379c7757 req-40103493-dee5-46a9-8ff2-0cf6e843f730 service nova] Creating event network-changed:1b4b6f67-a372-4741-8462-705b349b1f43 for instance e9000846-e56b-43f8-acf7-3ef136f0b43f on hv-cinder-85083 Aug 22 13:00:40.601013 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-bec6e056-e35e-4eda-b3c4-bf21379c7757 req-40103493-dee5-46a9-8ff2-0cf6e843f730 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033872 Aug 22 13:00:40.601695 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 537/1065] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 13:00:40.690935 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-627cbe3b-9394-4438-a37f-39b39929d927 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211667 Aug 22 13:00:40.691253 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 529/1066] 10.222.0.15 () {58 vars in 1125 bytes} [Mon Aug 22 13:00:40 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:00:40.703297 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-9c86bf2f-77bb-41aa-a2fa-568e118c7468 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:40.704001 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-9c86bf2f-77bb-41aa-a2fa-568e118c7468 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:40.710751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c86bf2f-77bb-41aa-a2fa-568e118c7468 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:40.711246 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c86bf2f-77bb-41aa-a2fa-568e118c7468 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:40.711688 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c86bf2f-77bb-41aa-a2fa-568e118c7468 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:40.712391 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c86bf2f-77bb-41aa-a2fa-568e118c7468 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:40.712876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c86bf2f-77bb-41aa-a2fa-568e118c7468 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:40.713498 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-9c86bf2f-77bb-41aa-a2fa-568e118c7468 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:40.794674 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-4c301299-becc-467f-8865-a832b56f0d44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:40.795409 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-4c301299-becc-467f-8865-a832b56f0d44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:40.805555 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c301299-becc-467f-8865-a832b56f0d44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:40.810225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c301299-becc-467f-8865-a832b56f0d44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:40.810225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c301299-becc-467f-8865-a832b56f0d44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:40.810225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c301299-becc-467f-8865-a832b56f0d44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:40.810225 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c301299-becc-467f-8865-a832b56f0d44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:40.810900 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-4c301299-becc-467f-8865-a832b56f0d44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:40.922773 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-9c86bf2f-77bb-41aa-a2fa-568e118c7468 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:40.933292 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-9c86bf2f-77bb-41aa-a2fa-568e118c7468 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1548 microversion: 2.1 time: 0.233401 Aug 22 13:00:40.948323 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 538/1067] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:40 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1548 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:40.986445 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-4c301299-becc-467f-8865-a832b56f0d44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:40.996887 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-4c301299-becc-467f-8865-a832b56f0d44 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1575 microversion: 2.1 time: 0.210627 Aug 22 13:00:40.997472 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 530/1068] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:40 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:00:42.019465 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-8fc96608-2bf1-4077-9e25-11e01e33cc5a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:42.020080 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-8fc96608-2bf1-4077-9e25-11e01e33cc5a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:42.027190 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc96608-2bf1-4077-9e25-11e01e33cc5a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:42.027679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc96608-2bf1-4077-9e25-11e01e33cc5a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:42.028114 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc96608-2bf1-4077-9e25-11e01e33cc5a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:42.028852 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc96608-2bf1-4077-9e25-11e01e33cc5a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:42.029307 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc96608-2bf1-4077-9e25-11e01e33cc5a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:42.029733 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-8fc96608-2bf1-4077-9e25-11e01e33cc5a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:42.168363 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-8fc96608-2bf1-4077-9e25-11e01e33cc5a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:42.175862 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-8fc96608-2bf1-4077-9e25-11e01e33cc5a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1575 microversion: 2.1 time: 0.160415 Aug 22 13:00:42.176418 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 539/1069] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:42 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:42.962411 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-88ecec5e-907e-4df2-b573-860736651672 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48cd69a3-0385-4daf-a776-1c654b7cd469"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:42.964800 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-88ecec5e-907e-4df2-b573-860736651672 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:42.971186 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-88ecec5e-907e-4df2-b573-860736651672 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:42.971667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-88ecec5e-907e-4df2-b573-860736651672 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:42.972099 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-88ecec5e-907e-4df2-b573-860736651672 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:42.972784 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-88ecec5e-907e-4df2-b573-860736651672 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:42.973235 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-88ecec5e-907e-4df2-b573-860736651672 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:42.973663 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-88ecec5e-907e-4df2-b573-860736651672 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:43.197447 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3b855fde-1b1d-4918-bf4e-71b4c783a163 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:43.198043 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3b855fde-1b1d-4918-bf4e-71b4c783a163 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:43.204344 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3b855fde-1b1d-4918-bf4e-71b4c783a163 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:43.204837 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3b855fde-1b1d-4918-bf4e-71b4c783a163 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:43.205270 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3b855fde-1b1d-4918-bf4e-71b4c783a163 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:43.205961 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3b855fde-1b1d-4918-bf4e-71b4c783a163 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:43.206443 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3b855fde-1b1d-4918-bf4e-71b4c783a163 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:43.206884 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3b855fde-1b1d-4918-bf4e-71b4c783a163 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:43.344162 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3b855fde-1b1d-4918-bf4e-71b4c783a163 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:43.352162 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3b855fde-1b1d-4918-bf4e-71b4c783a163 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1575 microversion: 2.1 time: 0.159124 Aug 22 13:00:43.352743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 540/1070] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:43 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:00:43.358235 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-a95111b7-9edd-4d9e-99ee-d96794869149 req-cbde1893-5e5c-453c-ba98-f0365b42b05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b42279-7db6-4c28-8557-014f54e9afef", "name": "network-vif-plugged", "status": "completed", "tag": "9a28b39e-e983-4692-a43c-7821a73d6e5b"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:43.367642 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-a95111b7-9edd-4d9e-99ee-d96794869149 req-cbde1893-5e5c-453c-ba98-f0365b42b05b service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:43.368131 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-a95111b7-9edd-4d9e-99ee-d96794869149 req-cbde1893-5e5c-453c-ba98-f0365b42b05b service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:43.368562 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-a95111b7-9edd-4d9e-99ee-d96794869149 req-cbde1893-5e5c-453c-ba98-f0365b42b05b service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:43.379485 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-a95111b7-9edd-4d9e-99ee-d96794869149 req-cbde1893-5e5c-453c-ba98-f0365b42b05b service nova] Creating event network-vif-plugged:9a28b39e-e983-4692-a43c-7821a73d6e5b for instance b4b42279-7db6-4c28-8557-014f54e9afef on hv-cinder-85083 Aug 22 13:00:43.384965 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-a95111b7-9edd-4d9e-99ee-d96794869149 req-cbde1893-5e5c-453c-ba98-f0365b42b05b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031129 Aug 22 13:00:43.386280 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 541/1071] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:00:43.752297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-88ecec5e-907e-4df2-b573-860736651672 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "POST /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794332 Aug 22 13:00:43.753038 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 531/1072] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 22 13:00:42 2022] POST /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:00:44.380036 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b29d82e3-8209-4b9e-ada7-7663731e14b3 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:44.381318 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b29d82e3-8209-4b9e-ada7-7663731e14b3 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:44.387474 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b29d82e3-8209-4b9e-ada7-7663731e14b3 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:44.387910 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b29d82e3-8209-4b9e-ada7-7663731e14b3 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:44.388347 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b29d82e3-8209-4b9e-ada7-7663731e14b3 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:44.389039 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b29d82e3-8209-4b9e-ada7-7663731e14b3 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:44.389497 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b29d82e3-8209-4b9e-ada7-7663731e14b3 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:44.389926 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b29d82e3-8209-4b9e-ada7-7663731e14b3 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:44.520377 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b29d82e3-8209-4b9e-ada7-7663731e14b3 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:44.528822 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b29d82e3-8209-4b9e-ada7-7663731e14b3 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1575 microversion: 2.1 time: 0.153445 Aug 22 13:00:44.529394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 542/1073] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:44 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:45.550202 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-62db3935-45ee-428c-8bf6-1096bb7605ef tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:45.555170 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-62db3935-45ee-428c-8bf6-1096bb7605ef tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:45.557870 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62db3935-45ee-428c-8bf6-1096bb7605ef tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:45.558399 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62db3935-45ee-428c-8bf6-1096bb7605ef tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:45.558837 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62db3935-45ee-428c-8bf6-1096bb7605ef tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:45.559541 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62db3935-45ee-428c-8bf6-1096bb7605ef tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:45.560015 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62db3935-45ee-428c-8bf6-1096bb7605ef tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:45.560425 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-62db3935-45ee-428c-8bf6-1096bb7605ef tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:45.693933 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-62db3935-45ee-428c-8bf6-1096bb7605ef tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:45.701618 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-62db3935-45ee-428c-8bf6-1096bb7605ef tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1562 microversion: 2.1 time: 0.156224 Aug 22 13:00:45.702206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 532/1074] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:45 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:52.382613 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-80e391e2-b372-4603-9b85-f84e971c6cff tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:52.383226 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-80e391e2-b372-4603-9b85-f84e971c6cff tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:52.389868 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80e391e2-b372-4603-9b85-f84e971c6cff tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:52.390390 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80e391e2-b372-4603-9b85-f84e971c6cff tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:52.390836 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80e391e2-b372-4603-9b85-f84e971c6cff tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:52.391531 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80e391e2-b372-4603-9b85-f84e971c6cff tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:52.391987 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80e391e2-b372-4603-9b85-f84e971c6cff tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:52.392415 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-80e391e2-b372-4603-9b85-f84e971c6cff tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:52.520370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-80e391e2-b372-4603-9b85-f84e971c6cff tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:52.529245 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-80e391e2-b372-4603-9b85-f84e971c6cff tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1594 microversion: 2.1 time: 0.150547 Aug 22 13:00:52.529843 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 543/1075] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:52 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1594 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:00:54.390238 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-86198d9a-2ad1-42be-91ad-e77e5beb54ab req-942984ed-5fd5-4daf-a829-95c298d3c2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00fc1738-a379-4fdf-b711-d9a75d2293f0", "tag": "50ba2d0a-f116-405a-ac83-eb2386fa3e53"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:54.395734 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell0:SELECT=2 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:54.401712 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-86198d9a-2ad1-42be-91ad-e77e5beb54ab req-942984ed-5fd5-4daf-a829-95c298d3c2b4 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:54.402219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-86198d9a-2ad1-42be-91ad-e77e5beb54ab req-942984ed-5fd5-4daf-a829-95c298d3c2b4 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:54.402655 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-86198d9a-2ad1-42be-91ad-e77e5beb54ab req-942984ed-5fd5-4daf-a829-95c298d3c2b4 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:54.413941 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-86198d9a-2ad1-42be-91ad-e77e5beb54ab req-942984ed-5fd5-4daf-a829-95c298d3c2b4 service nova] Creating event network-changed:50ba2d0a-f116-405a-ac83-eb2386fa3e53 for instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 on hv-cinder-85083 Aug 22 13:00:54.418834 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-86198d9a-2ad1-42be-91ad-e77e5beb54ab req-942984ed-5fd5-4daf-a829-95c298d3c2b4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032257 Aug 22 13:00:54.419430 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 533/1076] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:00:56.748533 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-a1d9ab3f-3d44-46f6-8e6e-67e7a786113c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-888118865"}} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:56.749079 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-a1d9ab3f-3d44-46f6-8e6e-67e7a786113c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:56.756501 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a1d9ab3f-3d44-46f6-8e6e-67e7a786113c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:56.756991 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a1d9ab3f-3d44-46f6-8e6e-67e7a786113c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:56.757424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a1d9ab3f-3d44-46f6-8e6e-67e7a786113c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:56.758122 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a1d9ab3f-3d44-46f6-8e6e-67e7a786113c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:56.758648 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a1d9ab3f-3d44-46f6-8e6e-67e7a786113c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:56.759138 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-a1d9ab3f-3d44-46f6-8e6e-67e7a786113c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:56.896952 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.network.security_group_api [None req-a1d9ab3f-3d44-46f6-8e6e-67e7a786113c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Adding security group d49d162b-2bb9-4c85-8095-8c9ab43bf7a7 to port 50ba2d0a-f116-405a-ac83-eb2386fa3e53 Aug 22 13:00:57.739821 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-a1d9ab3f-3d44-46f6-8e6e-67e7a786113c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "POST /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/action" status: 202 len: 0 microversion: 2.1 time: 0.996823 Aug 22 13:00:57.740435 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 544/1077] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 13:00:56 2022] POST /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/action => generated 0 bytes in 998 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 13:00:57.748903 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-dc0d0940-d537-4db7-9afb-526b08e8868d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:00:57.749595 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-dc0d0940-d537-4db7-9afb-526b08e8868d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:00:57.750111 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-052b36aa-08bf-4022-b5f1-93735a10aa7b req-33497f4f-724f-4bec-8301-95f8d2e9a641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00fc1738-a379-4fdf-b711-d9a75d2293f0", "tag": "50ba2d0a-f116-405a-ac83-eb2386fa3e53"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:00:57.756394 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dc0d0940-d537-4db7-9afb-526b08e8868d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:57.756892 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dc0d0940-d537-4db7-9afb-526b08e8868d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:57.757334 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dc0d0940-d537-4db7-9afb-526b08e8868d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:57.758310 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dc0d0940-d537-4db7-9afb-526b08e8868d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:57.758771 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dc0d0940-d537-4db7-9afb-526b08e8868d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:57.759200 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-dc0d0940-d537-4db7-9afb-526b08e8868d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:57.761235 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-052b36aa-08bf-4022-b5f1-93735a10aa7b req-33497f4f-724f-4bec-8301-95f8d2e9a641 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:00:57.761714 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-052b36aa-08bf-4022-b5f1-93735a10aa7b req-33497f4f-724f-4bec-8301-95f8d2e9a641 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:00:57.762144 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-052b36aa-08bf-4022-b5f1-93735a10aa7b req-33497f4f-724f-4bec-8301-95f8d2e9a641 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:00:57.775665 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-052b36aa-08bf-4022-b5f1-93735a10aa7b req-33497f4f-724f-4bec-8301-95f8d2e9a641 service nova] Creating event network-changed:50ba2d0a-f116-405a-ac83-eb2386fa3e53 for instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 on hv-cinder-85083 Aug 22 13:00:57.783646 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-052b36aa-08bf-4022-b5f1-93735a10aa7b req-33497f4f-724f-4bec-8301-95f8d2e9a641 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038020 Aug 22 13:00:57.784685 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 534/1078] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:00:57.942250 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-dc0d0940-d537-4db7-9afb-526b08e8868d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:00:57.952900 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-dc0d0940-d537-4db7-9afb-526b08e8868d tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1759 microversion: 2.1 time: 0.208155 Aug 22 13:00:57.953734 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 545/1079] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:00:57 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1759 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:20.303735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=31 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:01:20.304480 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:01:20.309379 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-8071885b-09fa-4097-810e-1e42e68c2639 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:01:20.316318 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-8071885b-09fa-4097-810e-1e42e68c2639 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:20.317651 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8071885b-09fa-4097-810e-1e42e68c2639 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:20.318139 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8071885b-09fa-4097-810e-1e42e68c2639 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:20.318603 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8071885b-09fa-4097-810e-1e42e68c2639 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:20.319319 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8071885b-09fa-4097-810e-1e42e68c2639 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:20.319780 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8071885b-09fa-4097-810e-1e42e68c2639 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:20.320207 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-8071885b-09fa-4097-810e-1e42e68c2639 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:20.557226 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-8071885b-09fa-4097-810e-1e42e68c2639 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "POST /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/action" status: 202 len: 0 microversion: 2.1 time: 0.254810 Aug 22 13:01:20.564855 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 535/1080] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 13:01:20 2022] POST /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 13:01:20.566844 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-3af278a6-333f-4a2b-b34a-6b66ee0ce833 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:20.567454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-3af278a6-333f-4a2b-b34a-6b66ee0ce833 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:20.570163 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=43 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:01:20.570923 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=82 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:01:20.575454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3af278a6-333f-4a2b-b34a-6b66ee0ce833 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:20.575934 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3af278a6-333f-4a2b-b34a-6b66ee0ce833 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:20.576544 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3af278a6-333f-4a2b-b34a-6b66ee0ce833 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:20.577256 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3af278a6-333f-4a2b-b34a-6b66ee0ce833 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:20.577693 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3af278a6-333f-4a2b-b34a-6b66ee0ce833 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:20.578113 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-3af278a6-333f-4a2b-b34a-6b66ee0ce833 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:20.724835 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-3af278a6-333f-4a2b-b34a-6b66ee0ce833 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:20.733144 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-3af278a6-333f-4a2b-b34a-6b66ee0ce833 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1751 microversion: 2.1 time: 0.170425 Aug 22 13:01:20.734066 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 546/1081] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:20 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:21.754811 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-78f7ab21-05d3-4518-b487-e882c6ca1f2c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:21.755511 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-78f7ab21-05d3-4518-b487-e882c6ca1f2c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:21.762025 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78f7ab21-05d3-4518-b487-e882c6ca1f2c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:21.762542 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78f7ab21-05d3-4518-b487-e882c6ca1f2c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:21.762974 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78f7ab21-05d3-4518-b487-e882c6ca1f2c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:21.763659 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78f7ab21-05d3-4518-b487-e882c6ca1f2c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:21.764110 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78f7ab21-05d3-4518-b487-e882c6ca1f2c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:21.764529 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-78f7ab21-05d3-4518-b487-e882c6ca1f2c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:21.902948 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-78f7ab21-05d3-4518-b487-e882c6ca1f2c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:21.911297 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-78f7ab21-05d3-4518-b487-e882c6ca1f2c tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1756 microversion: 2.1 time: 0.160776 Aug 22 13:01:21.911852 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 536/1082] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:21 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:22.933657 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ab4b1297-005a-4b5a-ab0f-8c5ccc5b0c32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:22.934335 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ab4b1297-005a-4b5a-ab0f-8c5ccc5b0c32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:22.940702 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ab4b1297-005a-4b5a-ab0f-8c5ccc5b0c32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:22.941190 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ab4b1297-005a-4b5a-ab0f-8c5ccc5b0c32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:22.941627 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ab4b1297-005a-4b5a-ab0f-8c5ccc5b0c32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:22.942377 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ab4b1297-005a-4b5a-ab0f-8c5ccc5b0c32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:22.942832 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ab4b1297-005a-4b5a-ab0f-8c5ccc5b0c32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:22.943255 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ab4b1297-005a-4b5a-ab0f-8c5ccc5b0c32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:23.081748 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ab4b1297-005a-4b5a-ab0f-8c5ccc5b0c32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:23.089793 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ab4b1297-005a-4b5a-ab0f-8c5ccc5b0c32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1756 microversion: 2.1 time: 0.160654 Aug 22 13:01:23.090387 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 547/1083] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:22 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:24.112261 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9d1b190c-8cad-4b2b-90b1-8ab800494fba tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:24.112879 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9d1b190c-8cad-4b2b-90b1-8ab800494fba tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:24.119820 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d1b190c-8cad-4b2b-90b1-8ab800494fba tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:24.120304 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d1b190c-8cad-4b2b-90b1-8ab800494fba tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:24.120741 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d1b190c-8cad-4b2b-90b1-8ab800494fba tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:24.121431 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d1b190c-8cad-4b2b-90b1-8ab800494fba tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:24.121886 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d1b190c-8cad-4b2b-90b1-8ab800494fba tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:24.122350 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9d1b190c-8cad-4b2b-90b1-8ab800494fba tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:24.274028 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-9d1b190c-8cad-4b2b-90b1-8ab800494fba tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:24.283487 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9d1b190c-8cad-4b2b-90b1-8ab800494fba tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1756 microversion: 2.1 time: 0.175307 Aug 22 13:01:24.284049 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 537/1084] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:24 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:25.304703 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b8e22a8e-7c42-4fe4-8766-ed41585f6879 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:25.305312 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b8e22a8e-7c42-4fe4-8766-ed41585f6879 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:25.311846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b8e22a8e-7c42-4fe4-8766-ed41585f6879 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:25.312395 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b8e22a8e-7c42-4fe4-8766-ed41585f6879 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:25.312764 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b8e22a8e-7c42-4fe4-8766-ed41585f6879 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:25.313454 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b8e22a8e-7c42-4fe4-8766-ed41585f6879 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:25.313907 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b8e22a8e-7c42-4fe4-8766-ed41585f6879 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:25.314364 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b8e22a8e-7c42-4fe4-8766-ed41585f6879 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:25.453448 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b8e22a8e-7c42-4fe4-8766-ed41585f6879 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:25.461541 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b8e22a8e-7c42-4fe4-8766-ed41585f6879 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1756 microversion: 2.1 time: 0.160650 Aug 22 13:01:25.462141 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 548/1085] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:25 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:26.484116 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-9295b1cc-b1d7-40db-923a-2eb8c7ef5716 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:26.484738 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-9295b1cc-b1d7-40db-923a-2eb8c7ef5716 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:26.491200 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9295b1cc-b1d7-40db-923a-2eb8c7ef5716 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:26.491717 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9295b1cc-b1d7-40db-923a-2eb8c7ef5716 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:26.492162 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9295b1cc-b1d7-40db-923a-2eb8c7ef5716 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:26.492891 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9295b1cc-b1d7-40db-923a-2eb8c7ef5716 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:26.493355 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9295b1cc-b1d7-40db-923a-2eb8c7ef5716 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:26.493783 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-9295b1cc-b1d7-40db-923a-2eb8c7ef5716 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:26.636804 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-9295b1cc-b1d7-40db-923a-2eb8c7ef5716 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:26.644920 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-9295b1cc-b1d7-40db-923a-2eb8c7ef5716 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1756 microversion: 2.1 time: 0.165055 Aug 22 13:01:26.645486 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 538/1086] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:26 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:27.666730 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-05c2accf-b9c0-415f-aa00-10e316cfb29f tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:27.667341 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-05c2accf-b9c0-415f-aa00-10e316cfb29f tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:27.673185 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-05c2accf-b9c0-415f-aa00-10e316cfb29f tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:27.673666 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-05c2accf-b9c0-415f-aa00-10e316cfb29f tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:27.674096 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-05c2accf-b9c0-415f-aa00-10e316cfb29f tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:27.674805 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-05c2accf-b9c0-415f-aa00-10e316cfb29f tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:27.675261 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-05c2accf-b9c0-415f-aa00-10e316cfb29f tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:27.675679 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-05c2accf-b9c0-415f-aa00-10e316cfb29f tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:27.814830 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-05c2accf-b9c0-415f-aa00-10e316cfb29f tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:27.826160 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-05c2accf-b9c0-415f-aa00-10e316cfb29f tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1756 microversion: 2.1 time: 0.163376 Aug 22 13:01:27.826819 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 549/1087] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:27 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:28.847461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6dd4b30e-9b37-4cb4-9f4e-5beccf4ffd34 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:28.848065 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6dd4b30e-9b37-4cb4-9f4e-5beccf4ffd34 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:28.855060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd4b30e-9b37-4cb4-9f4e-5beccf4ffd34 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:28.855544 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd4b30e-9b37-4cb4-9f4e-5beccf4ffd34 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:28.855980 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd4b30e-9b37-4cb4-9f4e-5beccf4ffd34 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:28.856668 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd4b30e-9b37-4cb4-9f4e-5beccf4ffd34 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:28.857126 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd4b30e-9b37-4cb4-9f4e-5beccf4ffd34 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:28.857548 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6dd4b30e-9b37-4cb4-9f4e-5beccf4ffd34 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:29.000164 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-6dd4b30e-9b37-4cb4-9f4e-5beccf4ffd34 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:29.008330 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6dd4b30e-9b37-4cb4-9f4e-5beccf4ffd34 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1756 microversion: 2.1 time: 0.164798 Aug 22 13:01:29.008910 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 539/1088] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:28 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:30.030111 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4cd63e4b-0864-49d3-a6dd-5a1db6ee5f32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:30.030772 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4cd63e4b-0864-49d3-a6dd-5a1db6ee5f32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:30.037154 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4cd63e4b-0864-49d3-a6dd-5a1db6ee5f32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:30.037634 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4cd63e4b-0864-49d3-a6dd-5a1db6ee5f32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:30.038066 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4cd63e4b-0864-49d3-a6dd-5a1db6ee5f32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:30.038776 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4cd63e4b-0864-49d3-a6dd-5a1db6ee5f32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:30.039226 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4cd63e4b-0864-49d3-a6dd-5a1db6ee5f32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:30.039649 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4cd63e4b-0864-49d3-a6dd-5a1db6ee5f32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:30.180348 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-4cd63e4b-0864-49d3-a6dd-5a1db6ee5f32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:30.189337 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4cd63e4b-0864-49d3-a6dd-5a1db6ee5f32 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1756 microversion: 2.1 time: 0.163206 Aug 22 13:01:30.190129 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 550/1089] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:30 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:31.216368 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-bb2f65dc-06ec-4c4f-abd8-8b3519777b25 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:31.217032 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-bb2f65dc-06ec-4c4f-abd8-8b3519777b25 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:31.223929 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb2f65dc-06ec-4c4f-abd8-8b3519777b25 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:31.224418 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb2f65dc-06ec-4c4f-abd8-8b3519777b25 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:31.224853 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb2f65dc-06ec-4c4f-abd8-8b3519777b25 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:31.225557 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb2f65dc-06ec-4c4f-abd8-8b3519777b25 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:31.226032 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb2f65dc-06ec-4c4f-abd8-8b3519777b25 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:31.226474 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-bb2f65dc-06ec-4c4f-abd8-8b3519777b25 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:31.380524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-bb2f65dc-06ec-4c4f-abd8-8b3519777b25 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:31.388730 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-bb2f65dc-06ec-4c4f-abd8-8b3519777b25 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1756 microversion: 2.1 time: 0.176348 Aug 22 13:01:31.389301 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 540/1090] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:31 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:32.411445 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-14b53ba9-97a9-43b8-9a43-9157295f90b3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:32.412056 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-14b53ba9-97a9-43b8-9a43-9157295f90b3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:32.419038 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14b53ba9-97a9-43b8-9a43-9157295f90b3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:32.419521 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14b53ba9-97a9-43b8-9a43-9157295f90b3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:32.419954 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14b53ba9-97a9-43b8-9a43-9157295f90b3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:32.420669 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14b53ba9-97a9-43b8-9a43-9157295f90b3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:32.421119 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14b53ba9-97a9-43b8-9a43-9157295f90b3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:32.421540 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14b53ba9-97a9-43b8-9a43-9157295f90b3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:32.562557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-14b53ba9-97a9-43b8-9a43-9157295f90b3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:32.571233 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-14b53ba9-97a9-43b8-9a43-9157295f90b3 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1756 microversion: 2.1 time: 0.163612 Aug 22 13:01:32.571796 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 551/1091] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:32 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:01:33.592207 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-2cf9088b-7930-4e28-9b3f-30fbfb9ae66b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:01:33.592823 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-2cf9088b-7930-4e28-9b3f-30fbfb9ae66b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:01:33.599223 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf9088b-7930-4e28-9b3f-30fbfb9ae66b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:33.599705 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf9088b-7930-4e28-9b3f-30fbfb9ae66b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:33.600142 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf9088b-7930-4e28-9b3f-30fbfb9ae66b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:33.600836 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf9088b-7930-4e28-9b3f-30fbfb9ae66b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:01:33.601292 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf9088b-7930-4e28-9b3f-30fbfb9ae66b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:01:33.601718 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-2cf9088b-7930-4e28-9b3f-30fbfb9ae66b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:01:33.744336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-2cf9088b-7930-4e28-9b3f-30fbfb9ae66b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:01:33.753124 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-2cf9088b-7930-4e28-9b3f-30fbfb9ae66b tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1759 microversion: 2.1 time: 0.164842 Aug 22 13:01:33.753690 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 541/1092] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:01:33 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:04.147302 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-55465163-cb81-4f28-a3bd-fee9ea93ace7 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:04.147846 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-55465163-cb81-4f28-a3bd-fee9ea93ace7 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:04.149637 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-9c56111e-2219-4ed7-b76d-f4fa7341c09c req-31d47d59-0c96-4b82-8b7a-9abc1dfd031a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b42279-7db6-4c28-8557-014f54e9afef", "tag": "9a28b39e-e983-4692-a43c-7821a73d6e5b"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:02:04.150371 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_api:SELECT=12 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:04.151233 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=36 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:04.155074 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_api:SELECT=14 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:04.155732 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG dbcounter [-] [127809] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:04.156248 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55465163-cb81-4f28-a3bd-fee9ea93ace7 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:04.156818 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55465163-cb81-4f28-a3bd-fee9ea93ace7 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:04.158206 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55465163-cb81-4f28-a3bd-fee9ea93ace7 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:04.165020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55465163-cb81-4f28-a3bd-fee9ea93ace7 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:04.165020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55465163-cb81-4f28-a3bd-fee9ea93ace7 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:04.165020 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-55465163-cb81-4f28-a3bd-fee9ea93ace7 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:04.165325 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-9c56111e-2219-4ed7-b76d-f4fa7341c09c req-31d47d59-0c96-4b82-8b7a-9abc1dfd031a service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:04.165325 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-9c56111e-2219-4ed7-b76d-f4fa7341c09c req-31d47d59-0c96-4b82-8b7a-9abc1dfd031a service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:04.165325 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-9c56111e-2219-4ed7-b76d-f4fa7341c09c req-31d47d59-0c96-4b82-8b7a-9abc1dfd031a service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:04.176349 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-9c56111e-2219-4ed7-b76d-f4fa7341c09c req-31d47d59-0c96-4b82-8b7a-9abc1dfd031a service nova] Creating event network-changed:9a28b39e-e983-4692-a43c-7821a73d6e5b for instance b4b42279-7db6-4c28-8557-014f54e9afef on hv-cinder-85083 Aug 22 13:02:04.181913 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-9c56111e-2219-4ed7-b76d-f4fa7341c09c req-31d47d59-0c96-4b82-8b7a-9abc1dfd031a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036220 Aug 22 13:02:04.182891 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 542/1093] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:02:04.185962 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-55465163-cb81-4f28-a3bd-fee9ea93ace7 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Going to try to terminate instance {{(pid=127810) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 13:02:04.480805 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-55465163-cb81-4f28-a3bd-fee9ea93ace7 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 204 len: 0 microversion: 2.1 time: 0.337142 Aug 22 13:02:04.481506 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 552/1094] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 13:02:04 2022] DELETE /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 13:02:04.490699 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-52d887bc-5d00-4c0e-80ee-102857ccaeed tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:04.491857 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-52d887bc-5d00-4c0e-80ee-102857ccaeed tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:04.500627 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52d887bc-5d00-4c0e-80ee-102857ccaeed tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:04.501326 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52d887bc-5d00-4c0e-80ee-102857ccaeed tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:04.501902 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52d887bc-5d00-4c0e-80ee-102857ccaeed tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:04.502669 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52d887bc-5d00-4c0e-80ee-102857ccaeed tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:04.503127 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52d887bc-5d00-4c0e-80ee-102857ccaeed tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:04.503560 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-52d887bc-5d00-4c0e-80ee-102857ccaeed tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:04.641113 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-52d887bc-5d00-4c0e-80ee-102857ccaeed tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:04.649584 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-52d887bc-5d00-4c0e-80ee-102857ccaeed tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.163257 Aug 22 13:02:04.650166 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 543/1095] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:04 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:05.672138 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-4d547865-23b0-4259-8e29-cbb4c025189a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:05.672835 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-4d547865-23b0-4259-8e29-cbb4c025189a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:05.679774 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d547865-23b0-4259-8e29-cbb4c025189a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:05.680264 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d547865-23b0-4259-8e29-cbb4c025189a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:05.680701 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d547865-23b0-4259-8e29-cbb4c025189a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:05.681392 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d547865-23b0-4259-8e29-cbb4c025189a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:05.681845 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d547865-23b0-4259-8e29-cbb4c025189a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:05.682293 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-4d547865-23b0-4259-8e29-cbb4c025189a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:05.817618 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-4d547865-23b0-4259-8e29-cbb4c025189a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:05.825376 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-4d547865-23b0-4259-8e29-cbb4c025189a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1568 microversion: 2.1 time: 0.157403 Aug 22 13:02:05.825935 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 553/1096] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:05 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:06.129442 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-48a5b88f-52d7-4ca9-b4d8-b02846afe76a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-888118865"}} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:02:06.130029 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-48a5b88f-52d7-4ca9-b4d8-b02846afe76a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:06.136637 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48a5b88f-52d7-4ca9-b4d8-b02846afe76a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:06.137123 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48a5b88f-52d7-4ca9-b4d8-b02846afe76a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:06.137559 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48a5b88f-52d7-4ca9-b4d8-b02846afe76a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:06.138281 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48a5b88f-52d7-4ca9-b4d8-b02846afe76a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:06.138737 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48a5b88f-52d7-4ca9-b4d8-b02846afe76a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:06.139160 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-48a5b88f-52d7-4ca9-b4d8-b02846afe76a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:06.264863 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.network.security_group_api [None req-48a5b88f-52d7-4ca9-b4d8-b02846afe76a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Removing security group d49d162b-2bb9-4c85-8095-8c9ab43bf7a7 from port 50ba2d0a-f116-405a-ac83-eb2386fa3e53 Aug 22 13:02:06.688860 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-48a5b88f-52d7-4ca9-b4d8-b02846afe76a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "POST /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/action" status: 202 len: 0 microversion: 2.1 time: 0.563426 Aug 22 13:02:06.689888 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 544/1097] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 22 13:02:06 2022] POST /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 13:02:06.697102 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-b88eef22-e3fa-48a6-b144-9d73381fa7be req-f6a03110-c8a6-48cf-a99f-d58aa600d8ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00fc1738-a379-4fdf-b711-d9a75d2293f0", "tag": "50ba2d0a-f116-405a-ac83-eb2386fa3e53"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:02:06.708740 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b88eef22-e3fa-48a6-b144-9d73381fa7be req-f6a03110-c8a6-48cf-a99f-d58aa600d8ca service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:06.709234 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b88eef22-e3fa-48a6-b144-9d73381fa7be req-f6a03110-c8a6-48cf-a99f-d58aa600d8ca service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:06.709668 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-b88eef22-e3fa-48a6-b144-9d73381fa7be req-f6a03110-c8a6-48cf-a99f-d58aa600d8ca service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:06.722110 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-b88eef22-e3fa-48a6-b144-9d73381fa7be req-f6a03110-c8a6-48cf-a99f-d58aa600d8ca service nova] Creating event network-changed:50ba2d0a-f116-405a-ac83-eb2386fa3e53 for instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 on hv-cinder-85083 Aug 22 13:02:06.727749 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-b88eef22-e3fa-48a6-b144-9d73381fa7be req-f6a03110-c8a6-48cf-a99f-d58aa600d8ca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034335 Aug 22 13:02:06.729413 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 554/1098] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 13:02:06.832139 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-17f6b0ac-4f6d-4f07-9d69-590d8e3f4c92 req-2ea4f421-d259-4320-9ace-f1ec630be02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b42279-7db6-4c28-8557-014f54e9afef", "name": "network-vif-deleted", "tag": "9a28b39e-e983-4692-a43c-7821a73d6e5b"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:02:06.848991 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-17f6b0ac-4f6d-4f07-9d69-590d8e3f4c92 req-2ea4f421-d259-4320-9ace-f1ec630be02a service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:06.849285 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-c5d5e392-1321-446f-aba1-444038118b5d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:06.850287 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-c5d5e392-1321-446f-aba1-444038118b5d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:06.850829 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-17f6b0ac-4f6d-4f07-9d69-590d8e3f4c92 req-2ea4f421-d259-4320-9ace-f1ec630be02a service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:06.851998 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-17f6b0ac-4f6d-4f07-9d69-590d8e3f4c92 req-2ea4f421-d259-4320-9ace-f1ec630be02a service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:06.859198 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5d5e392-1321-446f-aba1-444038118b5d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:06.860331 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5d5e392-1321-446f-aba1-444038118b5d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:06.860950 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5d5e392-1321-446f-aba1-444038118b5d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:06.861892 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5d5e392-1321-446f-aba1-444038118b5d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:06.863674 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5d5e392-1321-446f-aba1-444038118b5d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:06.864299 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-c5d5e392-1321-446f-aba1-444038118b5d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:06.868484 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-17f6b0ac-4f6d-4f07-9d69-590d8e3f4c92 req-2ea4f421-d259-4320-9ace-f1ec630be02a service nova] Creating event network-vif-deleted:9a28b39e-e983-4692-a43c-7821a73d6e5b for instance b4b42279-7db6-4c28-8557-014f54e9afef on hv-cinder-85083 Aug 22 13:02:06.874775 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-17f6b0ac-4f6d-4f07-9d69-590d8e3f4c92 req-2ea4f421-d259-4320-9ace-f1ec630be02a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048007 Aug 22 13:02:06.875997 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 545/1099] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:02:06.953590 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-c5d5e392-1321-446f-aba1-444038118b5d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:06.963855 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-c5d5e392-1321-446f-aba1-444038118b5d tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1382 microversion: 2.1 time: 0.120302 Aug 22 13:02:06.969539 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 555/1100] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:06 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1382 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:02:07.988426 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:07.989238 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:07.996148 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:07.996739 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:07.997242 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:07.998040 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:07.998638 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:07.999091 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:08.031957 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:08.032514 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:08.033138 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:08.033616 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lazy-loading 'fault' on Instance uuid b4b42279-7db6-4c28-8557-014f54e9afef {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 13:02:08.088517 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf10481821f149659859eff51f9c8cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4fa853dfd2483c8a3c2ac357f1af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:08.095648 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-284b9d3a-8d45-48b1-b69f-8424cfd8834a tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 200 len: 1223 microversion: 2.1 time: 0.112621 Aug 22 13:02:08.096270 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 546/1101] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:07 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 1223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:08.293812 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-94d54194-4404-4d77-903f-e5f600711106 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:08.294473 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-94d54194-4404-4d77-903f-e5f600711106 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:08.300988 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94d54194-4404-4d77-903f-e5f600711106 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:08.301473 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94d54194-4404-4d77-903f-e5f600711106 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:08.307936 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94d54194-4404-4d77-903f-e5f600711106 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:08.307936 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94d54194-4404-4d77-903f-e5f600711106 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:08.307936 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94d54194-4404-4d77-903f-e5f600711106 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:08.307936 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-94d54194-4404-4d77-903f-e5f600711106 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:08.394241 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-94d54194-4404-4d77-903f-e5f600711106 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lazy-loading 'services' on Instance uuid 00fc1738-a379-4fdf-b711-d9a75d2293f0 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 13:02:08.668849 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-94d54194-4404-4d77-903f-e5f600711106 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "DELETE /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments/48cd69a3-0385-4daf-a776-1c654b7cd469" status: 202 len: 0 microversion: 2.1 time: 0.378949 Aug 22 13:02:08.669692 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 556/1102] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 13:02:08 2022] DELETE /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments/48cd69a3-0385-4daf-a776-1c654b7cd469 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 13:02:08.679069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-6b977471-980b-44d3-baf6-1379409ab2bc tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:08.681435 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-6b977471-980b-44d3-baf6-1379409ab2bc tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:08.687454 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b977471-980b-44d3-baf6-1379409ab2bc tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:08.687936 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b977471-980b-44d3-baf6-1379409ab2bc tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:08.688368 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b977471-980b-44d3-baf6-1379409ab2bc tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:08.689060 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b977471-980b-44d3-baf6-1379409ab2bc tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:08.689515 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b977471-980b-44d3-baf6-1379409ab2bc tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:08.689932 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-6b977471-980b-44d3-baf6-1379409ab2bc tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:08.720420 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-6b977471-980b-44d3-baf6-1379409ab2bc tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045864 Aug 22 13:02:08.720998 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 547/1103] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 13:02:08 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 13:02:08.903477 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-f0b54429-147c-4570-acdb-2faa25b6aec6 req-01e6d063-965a-466c-94fc-cdfede4d51d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00fc1738-a379-4fdf-b711-d9a75d2293f0", "tag": "50ba2d0a-f116-405a-ac83-eb2386fa3e53"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:02:08.913646 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-f0b54429-147c-4570-acdb-2faa25b6aec6 req-01e6d063-965a-466c-94fc-cdfede4d51d3 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:08.913957 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-f0b54429-147c-4570-acdb-2faa25b6aec6 req-01e6d063-965a-466c-94fc-cdfede4d51d3 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:08.914424 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-f0b54429-147c-4570-acdb-2faa25b6aec6 req-01e6d063-965a-466c-94fc-cdfede4d51d3 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:08.925191 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-f0b54429-147c-4570-acdb-2faa25b6aec6 req-01e6d063-965a-466c-94fc-cdfede4d51d3 service nova] Creating event network-changed:50ba2d0a-f116-405a-ac83-eb2386fa3e53 for instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 on hv-cinder-85083 Aug 22 13:02:08.929933 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-f0b54429-147c-4570-acdb-2faa25b6aec6 req-01e6d063-965a-466c-94fc-cdfede4d51d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030717 Aug 22 13:02:08.931266 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 557/1104] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:02:09.118367 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:09.119026 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] [instance: b4b42279-7db6-4c28-8557-014f54e9afef] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:09.125812 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:09.126433 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:09.126900 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:09.127611 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:09.128068 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:09.128492 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:09.144333 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] HTTP exception thrown: Instance b4b42279-7db6-4c28-8557-014f54e9afef could not be found. Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Request method failure captured: Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef HTTP/1.1 Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA30tQaW51U9FrMzu968Q2CEjmm2_gBsY74_ucS1SSuI5oqY38x6Gm1zNA_JE-kVkueNSVagpptgBgoDmtv4diyA_bnS92WbhBjsVnnmb4vBP_eqlS2WA1ylIZmVhy03664sC4o9xcl_RF0gukdK3bRToigK3USFfnd3FCcQsEtqsdNk Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 5b4fa853dfd2483c8a3c2ac357f1af52 Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-TestShelveInstance-237727118 Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 13:02:09.150206 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5b4fa853dfd2483c8a3c2ac357f1af52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4fa853dfd2483c8a3c2ac357f1af52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4fa853dfd2483c8a3c2ac357f1af52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5b4fa853dfd2483c8a3c2ac357f1af52"}]}] Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-TestShelveInstance-237727118 Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 5b4fa853dfd2483c8a3c2ac357f1af52 Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-TestShelveInstance-237727118 Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-TestShelveInstance-237727118-project Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: bf10481821f149659859eff51f9c8cbb Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-TestShelveInstance-237727118-project Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance b4b42279-7db6-4c28-8557-014f54e9afef could not be found. Aug 22 13:02:09.152766 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': 'b4b42279-7db6-4c28-8557-014f54e9afef'} Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b42279-7db6-4c28-8557-014f54e9afef could not be found. Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 13:02:09.154708 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b42279-7db6-4c28-8557-014f54e9afef could not be found. Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b42279-7db6-4c28-8557-014f54e9afef could not be found. Aug 22 13:02:09.156446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:09.158132 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Returning 404 to user: Instance b4b42279-7db6-4c28-8557-014f54e9afef could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 13:02:09.158132 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-0c33e937-6511-452b-80fa-5a43b3b6d178 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef" status: 404 len: 111 microversion: 2.1 time: 0.033138 Aug 22 13:02:09.158132 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 548/1105] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:09 2022] GET /compute/v2.1/servers/b4b42279-7db6-4c28-8557-014f54e9afef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 13:02:09.644873 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-258b691e-ae42-49d3-9966-cafa3ed6d329 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] Calling method '.version_select at 0x7f7659c4fca0>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:09.716188 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-258b691e-ae42-49d3-9966-cafa3ed6d329 tempest-TestShelveInstance-237727118 tempest-TestShelveInstance-237727118-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-53318661" status: 202 len: 0 microversion: 2.1 time: 0.075763 Aug 22 13:02:09.716715 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 558/1106] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 22 13:02:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-53318661 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 13:02:09.736530 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-abbee0e2-5db4-4ee3-b14e-4838f7f1aba0 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:09.739423 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-abbee0e2-5db4-4ee3-b14e-4838f7f1aba0 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:09.749429 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-abbee0e2-5db4-4ee3-b14e-4838f7f1aba0 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:09.749604 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-abbee0e2-5db4-4ee3-b14e-4838f7f1aba0 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:09.750007 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-abbee0e2-5db4-4ee3-b14e-4838f7f1aba0 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:09.750765 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-abbee0e2-5db4-4ee3-b14e-4838f7f1aba0 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:09.751278 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-abbee0e2-5db4-4ee3-b14e-4838f7f1aba0 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:09.752256 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-abbee0e2-5db4-4ee3-b14e-4838f7f1aba0 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:09.787228 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-abbee0e2-5db4-4ee3-b14e-4838f7f1aba0 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057266 Aug 22 13:02:09.787804 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 549/1107] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 13:02:09 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:02:10.799631 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f26cd8d4-056d-4fcd-8fe3-9d30b80f2ab7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:10.801926 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-f26cd8d4-056d-4fcd-8fe3-9d30b80f2ab7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:10.810924 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f26cd8d4-056d-4fcd-8fe3-9d30b80f2ab7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:10.811448 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f26cd8d4-056d-4fcd-8fe3-9d30b80f2ab7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:10.811893 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f26cd8d4-056d-4fcd-8fe3-9d30b80f2ab7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:10.812797 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f26cd8d4-056d-4fcd-8fe3-9d30b80f2ab7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:10.813274 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f26cd8d4-056d-4fcd-8fe3-9d30b80f2ab7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:10.813704 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-f26cd8d4-056d-4fcd-8fe3-9d30b80f2ab7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:10.844794 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f26cd8d4-056d-4fcd-8fe3-9d30b80f2ab7 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048992 Aug 22 13:02:10.845645 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 559/1108] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 22 13:02:10 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 13:02:10.856195 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:10.856755 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:10.863878 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:10.864440 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:10.864891 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:10.865605 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:10.866069 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:10.866570 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:11.061844 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] HTTP exception thrown: Instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 is not attached to volume 48cd69a3-0385-4daf-a776-1c654b7cd469 Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Request method failure captured: Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: DELETE /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments/48cd69a3-0385-4daf-a776-1c654b7cd469 HTTP/1.1 Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA33O7_VXdzEo0rZnplyNtvDsW56H2YgoqqrpCTgKbvLvbx4gh2sdzAgJ-gYzKW7wn_G-JG7_XbJEJhQfsEO0zxRxyhYqENZJKtEEq8QaWY2_qHJEoV9xuzIEd3lvZZDZadTGWiu9v7ivKFRrCIMSH6wTUyaC-sQc7OYsGABgXth7nrc Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: dc8d034424a64918a43ca2b961aa2063 Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-TestMinimumBasicScenario-1718994637 Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 13:02:11.064191 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 13:02:11.073133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dc8d034424a64918a43ca2b961aa2063"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dc8d034424a64918a43ca2b961aa2063"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dc8d034424a64918a43ca2b961aa2063"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dc8d034424a64918a43ca2b961aa2063"}]}] Aug 22 13:02:11.073133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-TestMinimumBasicScenario-1718994637 Aug 22 13:02:11.073133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: dc8d034424a64918a43ca2b961aa2063 Aug 22 13:02:11.073133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1718994637 Aug 22 13:02:11.073133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-TestMinimumBasicScenario-1718994637-project Aug 22 13:02:11.073133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 13:02:11.073133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 13:02:11.073133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: af21f5997a3240a09dbcaab6d1580eef Aug 22 13:02:11.073133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-TestMinimumBasicScenario-1718994637-project Aug 22 13:02:11.073133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 13:02:11.073133 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 is not attached to volume 48cd69a3-0385-4daf-a776-1c654b7cd469 Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'server_id': '00fc1738-a379-4fdf-b711-d9a75d2293f0', 'id': '48cd69a3-0385-4daf-a776-1c654b7cd469'} Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 48cd69a3-0385-4daf-a776-1c654b7cd469. Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 13:02:11.074735 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 is not attached to volume 48cd69a3-0385-4daf-a776-1c654b7cd469 Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 is not attached to volume 48cd69a3-0385-4daf-a776-1c654b7cd469 Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:11.076286 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Returning 404 to user: Instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 is not attached to volume 48cd69a3-0385-4daf-a776-1c654b7cd469 {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 13:02:11.077497 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-a9f931d5-2e93-4f07-9cb8-5aa590ebf32a tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "DELETE /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments/48cd69a3-0385-4daf-a776-1c654b7cd469" status: 404 len: 154 microversion: 2.1 time: 0.213479 Aug 22 13:02:11.077497 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 550/1109] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 22 13:02:10 2022] DELETE /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0/os-volume_attachments/48cd69a3-0385-4daf-a776-1c654b7cd469 => generated 154 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 13:02:12.482527 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-14e4e21a-e7c5-4f99-8639-b69a1d59d539 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:12.483019 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-14e4e21a-e7c5-4f99-8639-b69a1d59d539 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:12.489646 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14e4e21a-e7c5-4f99-8639-b69a1d59d539 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:12.490142 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14e4e21a-e7c5-4f99-8639-b69a1d59d539 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:12.490617 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14e4e21a-e7c5-4f99-8639-b69a1d59d539 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:12.491317 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14e4e21a-e7c5-4f99-8639-b69a1d59d539 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:12.491782 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14e4e21a-e7c5-4f99-8639-b69a1d59d539 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:12.492214 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-14e4e21a-e7c5-4f99-8639-b69a1d59d539 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:12.524121 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-14e4e21a-e7c5-4f99-8639-b69a1d59d539 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Going to try to terminate instance {{(pid=127810) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 13:02:12.892501 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-14e4e21a-e7c5-4f99-8639-b69a1d59d539 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "DELETE /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 204 len: 0 microversion: 2.1 time: 0.413654 Aug 22 13:02:12.893735 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 560/1110] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 13:02:12 2022] DELETE /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 13:02:12.908345 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5233625e-505a-4155-a6ba-17f9263ad146 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:12.908972 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-5233625e-505a-4155-a6ba-17f9263ad146 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:12.918202 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5233625e-505a-4155-a6ba-17f9263ad146 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:12.918716 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5233625e-505a-4155-a6ba-17f9263ad146 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:12.919093 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5233625e-505a-4155-a6ba-17f9263ad146 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:12.919812 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5233625e-505a-4155-a6ba-17f9263ad146 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:12.920267 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5233625e-505a-4155-a6ba-17f9263ad146 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:12.920695 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5233625e-505a-4155-a6ba-17f9263ad146 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:13.119010 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-5233625e-505a-4155-a6ba-17f9263ad146 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:13.128719 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-5233625e-505a-4155-a6ba-17f9263ad146 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1554 microversion: 2.1 time: 0.224061 Aug 22 13:02:13.145783 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 551/1111] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:12 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:13.852006 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e6ffa8d8-8a42-4f50-b68c-b19627e52626 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:13.853180 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e6ffa8d8-8a42-4f50-b68c-b19627e52626 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:13.855422 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-16340346-891b-4c84-8545-9478325033ae req-4c1cac50-1497-4a20-a1a4-934a61982d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9000846-e56b-43f8-acf7-3ef136f0b43f", "tag": "1b4b6f67-a372-4741-8462-705b349b1f43"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:02:13.860440 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ffa8d8-8a42-4f50-b68c-b19627e52626 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:13.861136 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ffa8d8-8a42-4f50-b68c-b19627e52626 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:13.861763 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ffa8d8-8a42-4f50-b68c-b19627e52626 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:13.862745 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ffa8d8-8a42-4f50-b68c-b19627e52626 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:13.863376 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ffa8d8-8a42-4f50-b68c-b19627e52626 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:13.863974 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e6ffa8d8-8a42-4f50-b68c-b19627e52626 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:13.872783 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-16340346-891b-4c84-8545-9478325033ae req-4c1cac50-1497-4a20-a1a4-934a61982d6f service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:13.873806 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-16340346-891b-4c84-8545-9478325033ae req-4c1cac50-1497-4a20-a1a4-934a61982d6f service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:13.874452 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-16340346-891b-4c84-8545-9478325033ae req-4c1cac50-1497-4a20-a1a4-934a61982d6f service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:13.889568 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-16340346-891b-4c84-8545-9478325033ae req-4c1cac50-1497-4a20-a1a4-934a61982d6f service nova] Creating event network-changed:1b4b6f67-a372-4741-8462-705b349b1f43 for instance e9000846-e56b-43f8-acf7-3ef136f0b43f on hv-cinder-85083 Aug 22 13:02:13.891964 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e6ffa8d8-8a42-4f50-b68c-b19627e52626 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Going to try to terminate instance {{(pid=127810) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 13:02:13.898226 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-16340346-891b-4c84-8545-9478325033ae req-4c1cac50-1497-4a20-a1a4-934a61982d6f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047293 Aug 22 13:02:13.900553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 552/1112] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:02:14.165503 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b9ed604a-f03d-4fce-b7b5-7b989339ded9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:14.166736 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b9ed604a-f03d-4fce-b7b5-7b989339ded9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:14.177004 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed604a-f03d-4fce-b7b5-7b989339ded9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:14.177861 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed604a-f03d-4fce-b7b5-7b989339ded9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:14.178664 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed604a-f03d-4fce-b7b5-7b989339ded9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:14.179854 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed604a-f03d-4fce-b7b5-7b989339ded9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:14.180726 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed604a-f03d-4fce-b7b5-7b989339ded9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:14.181458 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b9ed604a-f03d-4fce-b7b5-7b989339ded9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:14.189472 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e6ffa8d8-8a42-4f50-b68c-b19627e52626 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 204 len: 0 microversion: 2.1 time: 0.341449 Aug 22 13:02:14.190956 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 561/1113] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 13:02:13 2022] DELETE /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 13:02:14.202382 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-521340b2-09ba-4edc-b6b9-58d8f2b7d1ff tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:14.203806 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-521340b2-09ba-4edc-b6b9-58d8f2b7d1ff tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:14.210449 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521340b2-09ba-4edc-b6b9-58d8f2b7d1ff tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:14.211209 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521340b2-09ba-4edc-b6b9-58d8f2b7d1ff tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:14.211848 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521340b2-09ba-4edc-b6b9-58d8f2b7d1ff tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:14.212754 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521340b2-09ba-4edc-b6b9-58d8f2b7d1ff tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:14.213702 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521340b2-09ba-4edc-b6b9-58d8f2b7d1ff tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:14.214374 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-521340b2-09ba-4edc-b6b9-58d8f2b7d1ff tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:14.537057 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-b9ed604a-f03d-4fce-b7b5-7b989339ded9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:14.540270 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-521340b2-09ba-4edc-b6b9-58d8f2b7d1ff tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:14.558036 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-521340b2-09ba-4edc-b6b9-58d8f2b7d1ff tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1580 microversion: 2.1 time: 0.361271 Aug 22 13:02:14.559688 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 562/1114] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:14 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1580 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:14.560271 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b9ed604a-f03d-4fce-b7b5-7b989339ded9 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1554 microversion: 2.1 time: 0.401896 Aug 22 13:02:14.560847 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 553/1115] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:14 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1554 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:02:15.582129 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e1745de6-672a-4b4a-a54d-83619cda620c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:15.582686 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-06204283-a0dd-43fb-942f-651eb7a0f3db tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:15.583070 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-06204283-a0dd-43fb-942f-651eb7a0f3db tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:15.583199 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-e1745de6-672a-4b4a-a54d-83619cda620c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:15.589853 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1745de6-672a-4b4a-a54d-83619cda620c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:15.590105 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06204283-a0dd-43fb-942f-651eb7a0f3db tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:15.590792 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1745de6-672a-4b4a-a54d-83619cda620c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:15.590982 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06204283-a0dd-43fb-942f-651eb7a0f3db tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:15.591585 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06204283-a0dd-43fb-942f-651eb7a0f3db tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:15.591868 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1745de6-672a-4b4a-a54d-83619cda620c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:15.592781 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06204283-a0dd-43fb-942f-651eb7a0f3db tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:15.593080 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1745de6-672a-4b4a-a54d-83619cda620c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:15.593571 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06204283-a0dd-43fb-942f-651eb7a0f3db tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:15.593809 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1745de6-672a-4b4a-a54d-83619cda620c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:15.594366 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-06204283-a0dd-43fb-942f-651eb7a0f3db tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:15.594493 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-e1745de6-672a-4b4a-a54d-83619cda620c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:16.215162 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-e1745de6-672a-4b4a-a54d-83619cda620c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:16.223150 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-06204283-a0dd-43fb-942f-651eb7a0f3db tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:16.225162 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e1745de6-672a-4b4a-a54d-83619cda620c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1580 microversion: 2.1 time: 0.648620 Aug 22 13:02:16.238239 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 563/1116] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:15 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1580 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:16.238451 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-06204283-a0dd-43fb-942f-651eb7a0f3db tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1554 microversion: 2.1 time: 0.656659 Aug 22 13:02:16.245098 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 554/1117] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:15 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1554 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:16.562168 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [req-0930f6e9-1ae3-43e7-9616-ba23ad203de5 req-85a14fb8-462e-491c-af4d-00f36b50c137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00fc1738-a379-4fdf-b711-d9a75d2293f0", "name": "network-vif-deleted", "tag": "50ba2d0a-f116-405a-ac83-eb2386fa3e53"}]} {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:02:16.571820 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-0930f6e9-1ae3-43e7-9616-ba23ad203de5 req-85a14fb8-462e-491c-af4d-00f36b50c137 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:16.572538 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-0930f6e9-1ae3-43e7-9616-ba23ad203de5 req-85a14fb8-462e-491c-af4d-00f36b50c137 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:16.573148 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [req-0930f6e9-1ae3-43e7-9616-ba23ad203de5 req-85a14fb8-462e-491c-af4d-00f36b50c137 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:16.587557 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.compute.server_external_events [req-0930f6e9-1ae3-43e7-9616-ba23ad203de5 req-85a14fb8-462e-491c-af4d-00f36b50c137 service nova] Creating event network-vif-deleted:50ba2d0a-f116-405a-ac83-eb2386fa3e53 for instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 on hv-cinder-85083 Aug 22 13:02:16.592633 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [req-0930f6e9-1ae3-43e7-9616-ba23ad203de5 req-85a14fb8-462e-491c-af4d-00f36b50c137 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034971 Aug 22 13:02:16.593164 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 564/1118] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:02:17.249952 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-ace79ac2-0508-4f4e-be89-75d0b7620f05 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:17.251283 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-ace79ac2-0508-4f4e-be89-75d0b7620f05 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:17.257340 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:17.258374 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:17.258844 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ace79ac2-0508-4f4e-be89-75d0b7620f05 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:17.259549 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ace79ac2-0508-4f4e-be89-75d0b7620f05 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:17.259992 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ace79ac2-0508-4f4e-be89-75d0b7620f05 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:17.266346 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ace79ac2-0508-4f4e-be89-75d0b7620f05 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:17.267088 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ace79ac2-0508-4f4e-be89-75d0b7620f05 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:17.271246 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-ace79ac2-0508-4f4e-be89-75d0b7620f05 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:17.271948 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:17.272463 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:17.273089 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:17.273860 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:17.274536 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:17.275138 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:17.336197 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:17.336661 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:17.337286 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:17.337906 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.objects.instance [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lazy-loading 'fault' on Instance uuid 00fc1738-a379-4fdf-b711-d9a75d2293f0 {{(pid=127810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 13:02:17.344193 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG dbcounter [-] [127810] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=127810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:17.457323 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-ace79ac2-0508-4f4e-be89-75d0b7620f05 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:17.465988 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-ace79ac2-0508-4f4e-be89-75d0b7620f05 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1226 microversion: 2.1 time: 0.220822 Aug 22 13:02:17.466971 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 555/1119] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:17 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1226 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:17.485705 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af21f5997a3240a09dbcaab6d1580eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8d034424a64918a43ca2b961aa2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:17.494189 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-d7230e56-fb91-40e3-82c1-ca22b23be018 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 200 len: 1349 microversion: 2.1 time: 0.242200 Aug 22 13:02:17.496185 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 565/1120] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:17 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 1349 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 13:02:18.486956 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:18.487756 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:18.494494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:18.494980 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:18.495416 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:18.496104 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:18.496561 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:18.496987 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:18.524448 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:18.525218 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] [instance: 00fc1738-a379-4fdf-b711-d9a75d2293f0] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:18.529516 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:18.530011 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:18.530712 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:18.531154 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.objects.instance [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lazy-loading 'fault' on Instance uuid e9000846-e56b-43f8-acf7-3ef136f0b43f {{(pid=127809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 13:02:18.537959 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:18.543097 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:18.543097 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:18.543097 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:18.543097 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:18.544808 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:18.570920 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] HTTP exception thrown: Instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 could not be found. Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Request method failure captured: Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 HTTP/1.1 Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA33O7_VXdzEo0rZnplyNtvDsW56H2YgoqqrpCTgKbvLvbx4gh2sdzAgJ-gYzKW7wn_G-JG7_XbJEJhQfsEO0zxRxyhYqENZJKtEEq8QaWY2_qHJEoV9xuzIEd3lvZZDZadTGWiu9v7ivKFRrCIMSH6wTUyaC-sQc7OYsGABgXth7nrc Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: dc8d034424a64918a43ca2b961aa2063 Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-TestMinimumBasicScenario-1718994637 Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 13:02:18.578003 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dc8d034424a64918a43ca2b961aa2063"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dc8d034424a64918a43ca2b961aa2063"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dc8d034424a64918a43ca2b961aa2063"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dc8d034424a64918a43ca2b961aa2063"}]}] Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-TestMinimumBasicScenario-1718994637 Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: dc8d034424a64918a43ca2b961aa2063 Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1718994637 Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-TestMinimumBasicScenario-1718994637-project Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: af21f5997a3240a09dbcaab6d1580eef Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-TestMinimumBasicScenario-1718994637-project Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 could not be found. Aug 22 13:02:18.579919 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': '00fc1738-a379-4fdf-b711-d9a75d2293f0'} Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 could not be found. Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 13:02:18.581710 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 could not be found. Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 could not be found. Aug 22 13:02:18.583361 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 13:02:18.584882 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Returning 404 to user: Instance 00fc1738-a379-4fdf-b711-d9a75d2293f0 could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 13:02:18.584882 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-7abcbf39-d3e6-48f6-8983-c43e9f55ef14 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0" status: 404 len: 111 microversion: 2.1 time: 0.055481 Aug 22 13:02:18.584882 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 566/1121] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:18 2022] GET /compute/v2.1/servers/00fc1738-a379-4fdf-b711-d9a75d2293f0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 13:02:18.585152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:18.585152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-87d1790a-d1c4-44e8-823a-a37242b412d7 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 200 len: 1231 microversion: 2.1 time: 0.101201 Aug 22 13:02:18.585152 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 556/1122] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:18 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:18.595871 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-e9a424ae-be66-4df1-819c-7b01a604dcf6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] Calling method '.version_select at 0x7f765b2b2a60>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:18.618422 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-e1e43a46-9ade-4e45-afed-7bc595bab095 req-f079b70f-1020-43fd-9d63-441ebf6d99c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9000846-e56b-43f8-acf7-3ef136f0b43f", "name": "network-vif-deleted", "tag": "1b4b6f67-a372-4741-8462-705b349b1f43"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:02:18.627559 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-e1e43a46-9ade-4e45-afed-7bc595bab095 req-f079b70f-1020-43fd-9d63-441ebf6d99c0 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:18.632822 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-e1e43a46-9ade-4e45-afed-7bc595bab095 req-f079b70f-1020-43fd-9d63-441ebf6d99c0 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:18.632822 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-e1e43a46-9ade-4e45-afed-7bc595bab095 req-f079b70f-1020-43fd-9d63-441ebf6d99c0 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:18.639973 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-e1e43a46-9ade-4e45-afed-7bc595bab095 req-f079b70f-1020-43fd-9d63-441ebf6d99c0 service nova] Creating event network-vif-deleted:1b4b6f67-a372-4741-8462-705b349b1f43 for instance e9000846-e56b-43f8-acf7-3ef136f0b43f on hv-cinder-85083 Aug 22 13:02:18.645465 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-e1e43a46-9ade-4e45-afed-7bc595bab095 req-f079b70f-1020-43fd-9d63-441ebf6d99c0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031028 Aug 22 13:02:18.646134 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 557/1123] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 13:02:18.671063 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-e9a424ae-be66-4df1-819c-7b01a604dcf6 tempest-TestMinimumBasicScenario-1718994637 tempest-TestMinimumBasicScenario-1718994637-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1079357888" status: 202 len: 0 microversion: 2.1 time: 0.086177 Aug 22 13:02:18.671807 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 567/1124] 10.222.0.15 () {58 vars in 1272 bytes} [Mon Aug 22 13:02:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1079357888 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 13:02:19.606051 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:19.606801 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: e9000846-e56b-43f8-acf7-3ef136f0b43f] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:19.613511 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:19.614213 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:19.614655 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:19.615453 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:19.615918 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:19.616347 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:19.631847 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] HTTP exception thrown: Instance e9000846-e56b-43f8-acf7-3ef136f0b43f could not be found. Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Request method failure captured: Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f HTTP/1.1 Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3yTwuST5r9fL1c_dUZDanGAXYCGhSx7ErDhX51j-bsg-MclPAaHS2XiuibCslWy_d4pEBuGv-tu35_sCIEq6UFyHD4RSx-B4zqdWTeq7NEBinZ_f8HO1Hbbl147E5CEiK_eo0i7pqkm6uCc6wlbHSnpD5ZPIUCcENCUQpg1_CFakYE Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 66ab7e2f4bbd43f4a795a5f1068a32f9 Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 13:02:19.633569 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}] Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 66ab7e2f4bbd43f4a795a5f1068a32f9 Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-TestVolumeBootPattern-288792624-project Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 35306cf75bde4fdcbb1374fa9ab82aa7 Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-TestVolumeBootPattern-288792624-project Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance e9000846-e56b-43f8-acf7-3ef136f0b43f could not be found. Aug 22 13:02:19.635352 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': 'e9000846-e56b-43f8-acf7-3ef136f0b43f'} Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9000846-e56b-43f8-acf7-3ef136f0b43f could not be found. Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 13:02:19.636229 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9000846-e56b-43f8-acf7-3ef136f0b43f could not be found. Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9000846-e56b-43f8-acf7-3ef136f0b43f could not be found. Aug 22 13:02:19.637574 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:19.638913 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Returning 404 to user: Instance e9000846-e56b-43f8-acf7-3ef136f0b43f could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 13:02:19.638913 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-d4e281ec-1d93-40fd-ac91-eb76d785d6bc tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f" status: 404 len: 111 microversion: 2.1 time: 0.033751 Aug 22 13:02:19.638913 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 558/1125] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:19 2022] GET /compute/v2.1/servers/e9000846-e56b-43f8-acf7-3ef136f0b43f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 13:02:23.339005 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-13bc1cd6-9ed1-4be2-a2c0-e35dd15af607 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:23.339509 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-13bc1cd6-9ed1-4be2-a2c0-e35dd15af607 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:23.346873 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-d8d0fd4c-9f66-4095-9848-81805a494607 req-f2d5acea-546d-488a-892d-cf578b362273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8259dfc6-578c-47a3-9339-b92f749bef34", "tag": "d51a6416-9839-49d0-8553-55806f7230d1"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:02:23.369370 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-13bc1cd6-9ed1-4be2-a2c0-e35dd15af607 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:23.372109 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-13bc1cd6-9ed1-4be2-a2c0-e35dd15af607 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:23.377799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-13bc1cd6-9ed1-4be2-a2c0-e35dd15af607 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:23.377799 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-13bc1cd6-9ed1-4be2-a2c0-e35dd15af607 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:23.378535 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d8d0fd4c-9f66-4095-9848-81805a494607 req-f2d5acea-546d-488a-892d-cf578b362273 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:23.378535 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d8d0fd4c-9f66-4095-9848-81805a494607 req-f2d5acea-546d-488a-892d-cf578b362273 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:23.378714 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-13bc1cd6-9ed1-4be2-a2c0-e35dd15af607 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:23.378912 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-13bc1cd6-9ed1-4be2-a2c0-e35dd15af607 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:23.384606 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-d8d0fd4c-9f66-4095-9848-81805a494607 req-f2d5acea-546d-488a-892d-cf578b362273 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:23.396835 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-d8d0fd4c-9f66-4095-9848-81805a494607 req-f2d5acea-546d-488a-892d-cf578b362273 service nova] Creating event network-changed:d51a6416-9839-49d0-8553-55806f7230d1 for instance 8259dfc6-578c-47a3-9339-b92f749bef34 on hv-cinder-85083 Aug 22 13:02:23.411126 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-d8d0fd4c-9f66-4095-9848-81805a494607 req-f2d5acea-546d-488a-892d-cf578b362273 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067889 Aug 22 13:02:23.412578 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 559/1126] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:02:23.421304 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-13bc1cd6-9ed1-4be2-a2c0-e35dd15af607 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Going to try to terminate instance {{(pid=127810) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 13:02:23.716231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-13bc1cd6-9ed1-4be2-a2c0-e35dd15af607 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 204 len: 0 microversion: 2.1 time: 0.378164 Aug 22 13:02:23.716231 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 568/1127] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 13:02:23 2022] DELETE /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 13:02:23.725121 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-68c136e5-2f5c-4dc7-803c-1f89d6573f72 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:23.726091 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-68c136e5-2f5c-4dc7-803c-1f89d6573f72 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:23.732584 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-68c136e5-2f5c-4dc7-803c-1f89d6573f72 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:23.733339 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-68c136e5-2f5c-4dc7-803c-1f89d6573f72 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:23.734088 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-68c136e5-2f5c-4dc7-803c-1f89d6573f72 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:23.735303 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-68c136e5-2f5c-4dc7-803c-1f89d6573f72 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:23.735960 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-68c136e5-2f5c-4dc7-803c-1f89d6573f72 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:23.736587 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-68c136e5-2f5c-4dc7-803c-1f89d6573f72 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:23.958973 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.policy [None req-68c136e5-2f5c-4dc7-803c-1f89d6573f72 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:23.967126 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-68c136e5-2f5c-4dc7-803c-1f89d6573f72 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1579 microversion: 2.1 time: 0.247635 Aug 22 13:02:23.967701 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 560/1128] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:23 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1579 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:24.989522 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-ac726ef9-acee-43da-a0ea-e7e869ae73e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:24.990278 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-ac726ef9-acee-43da-a0ea-e7e869ae73e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:24.997005 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ac726ef9-acee-43da-a0ea-e7e869ae73e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:24.997829 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ac726ef9-acee-43da-a0ea-e7e869ae73e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:24.998529 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ac726ef9-acee-43da-a0ea-e7e869ae73e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:24.999488 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ac726ef9-acee-43da-a0ea-e7e869ae73e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:25.000173 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ac726ef9-acee-43da-a0ea-e7e869ae73e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:25.000663 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-ac726ef9-acee-43da-a0ea-e7e869ae73e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:25.547499 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-ac726ef9-acee-43da-a0ea-e7e869ae73e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:25.556892 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-ac726ef9-acee-43da-a0ea-e7e869ae73e5 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1579 microversion: 2.1 time: 0.571442 Aug 22 13:02:25.557542 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 569/1129] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:24 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1579 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:26.054428 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [req-baec0a9e-4ffe-49ec-b8b7-ad986eb2de47 req-a039c45f-db38-49f1-be13-52f22371ebc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8259dfc6-578c-47a3-9339-b92f749bef34", "name": "network-vif-deleted", "tag": "d51a6416-9839-49d0-8553-55806f7230d1"}]} {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 13:02:26.063954 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-baec0a9e-4ffe-49ec-b8b7-ad986eb2de47 req-a039c45f-db38-49f1-be13-52f22371ebc6 service nova] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:26.064437 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-baec0a9e-4ffe-49ec-b8b7-ad986eb2de47 req-a039c45f-db38-49f1-be13-52f22371ebc6 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:26.064958 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [req-baec0a9e-4ffe-49ec-b8b7-ad986eb2de47 req-a039c45f-db38-49f1-be13-52f22371ebc6 service nova] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:26.075763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.compute.server_external_events [req-baec0a9e-4ffe-49ec-b8b7-ad986eb2de47 req-a039c45f-db38-49f1-be13-52f22371ebc6 service nova] Creating event network-vif-deleted:d51a6416-9839-49d0-8553-55806f7230d1 for instance 8259dfc6-578c-47a3-9339-b92f749bef34 on hv-cinder-85083 Aug 22 13:02:26.080547 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [req-baec0a9e-4ffe-49ec-b8b7-ad986eb2de47 req-a039c45f-db38-49f1-be13-52f22371ebc6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030413 Aug 22 13:02:26.091630 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 561/1130] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 22 13:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 13:02:26.579495 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-b35ad189-955a-4c34-a1b8-f45cf0117b9c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:26.581876 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-b35ad189-955a-4c34-a1b8-f45cf0117b9c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:26.592690 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b35ad189-955a-4c34-a1b8-f45cf0117b9c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:26.593432 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b35ad189-955a-4c34-a1b8-f45cf0117b9c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:26.594064 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b35ad189-955a-4c34-a1b8-f45cf0117b9c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:26.594985 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b35ad189-955a-4c34-a1b8-f45cf0117b9c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:26.595607 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b35ad189-955a-4c34-a1b8-f45cf0117b9c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:26.596235 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-b35ad189-955a-4c34-a1b8-f45cf0117b9c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:26.667551 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.policy [None req-b35ad189-955a-4c34-a1b8-f45cf0117b9c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35306cf75bde4fdcbb1374fa9ab82aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 13:02:26.676379 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-b35ad189-955a-4c34-a1b8-f45cf0117b9c tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 200 len: 1226 microversion: 2.1 time: 0.101525 Aug 22 13:02:26.677094 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 570/1131] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:26 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 13:02:27.699759 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:27.700447 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: 8259dfc6-578c-47a3-9339-b92f749bef34] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:27.707076 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:27.707553 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:27.707984 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:27.708667 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:27.709120 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:27.709538 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:27.723083 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] HTTP exception thrown: Instance 8259dfc6-578c-47a3-9339-b92f749bef34 could not be found. Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Request method failure captured: Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 HTTP/1.1 Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3yTwuST5r9fL1c_dUZDanGAXYCGhSx7ErDhX51j-bsg-MclPAaHS2XiuibCslWy_d4pEBuGv-tu35_sCIEq6UFyHD4RSx-B4zqdWTeq7NEBinZ_f8HO1Hbbl147E5CEiK_eo0i7pqkm6uCc6wlbHSnpD5ZPIUCcENCUQpg1_CFakYE Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 66ab7e2f4bbd43f4a795a5f1068a32f9 Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 13:02:27.724681 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}] Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 66ab7e2f4bbd43f4a795a5f1068a32f9 Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-TestVolumeBootPattern-288792624-project Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 35306cf75bde4fdcbb1374fa9ab82aa7 Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-TestVolumeBootPattern-288792624-project Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance 8259dfc6-578c-47a3-9339-b92f749bef34 could not be found. Aug 22 13:02:27.726505 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': '8259dfc6-578c-47a3-9339-b92f749bef34'} Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8259dfc6-578c-47a3-9339-b92f749bef34 could not be found. Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 13:02:27.727524 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8259dfc6-578c-47a3-9339-b92f749bef34 could not be found. Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8259dfc6-578c-47a3-9339-b92f749bef34 could not be found. Aug 22 13:02:27.729219 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:27.730731 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Returning 404 to user: Instance 8259dfc6-578c-47a3-9339-b92f749bef34 could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 13:02:27.730731 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-5c324837-f39f-485a-a820-342937e0640a tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34" status: 404 len: 111 microversion: 2.1 time: 0.031081 Aug 22 13:02:27.730731 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 562/1132] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:27 2022] GET /compute/v2.1/servers/8259dfc6-578c-47a3-9339-b92f749bef34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 13:02:28.520484 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:28.521023 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.compute.api [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127810) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:28.527385 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:28.529445 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:28.529445 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:28.529445 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:28.529445 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:28.529838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG oslo_concurrency.lockutils [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:28.543181 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.wsgi [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] HTTP exception thrown: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Request method failure captured: Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: request: DELETE /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c HTTP/1.1 Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept: application/json Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Accept-Encoding: identity Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Connection: close Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Length: 0 Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Content-Type: application/json Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Host: 10.222.0.15 Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Openstack-System-Scope: None Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: User-Agent: python-urllib3/1.26.11 Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Auth-Token: gAAAAABjA3yTwuST5r9fL1c_dUZDanGAXYCGhSx7ErDhX51j-bsg-MclPAaHS2XiuibCslWy_d4pEBuGv-tu35_sCIEq6UFyHD4RSx-B4zqdWTeq7NEBinZ_f8HO1Hbbl147E5CEiK_eo0i7pqkm6uCc6wlbHSnpD5ZPIUCcENCUQpg1_CFakYE Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Id: None Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Domain-Name: None Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Identity-Status: Confirmed Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Is-Admin-Project: True Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Id: default Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Domain-Name: Default Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Id: 66ab7e2f4bbd43f4a795a5f1068a32f9 Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Project-Name: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Role: member,reader Aug 22 13:02:28.544838 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Roles: member,reader Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}] Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Id: 66ab7e2f4bbd43f4a795a5f1068a32f9 Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-Tenant-Name: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User: tempest-TestVolumeBootPattern-288792624-project Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Id: default Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Domain-Name: Default Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Id: 35306cf75bde4fdcbb1374fa9ab82aa7 Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: X-User-Name: tempest-TestVolumeBootPattern-288792624-project Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: method: > Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: exception: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 13:02:28.546751 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: action_args: {'id': 'a4c83c81-7a50-4a24-a5c4-59c2af75792c'} Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 13:02:28.547743 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 13:02:28.549901 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: ERROR nova.api.openstack.wsgi Aug 22 13:02:28.551553 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Returning 404 to user: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. {{(pid=127810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 13:02:28.551553 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-57190a51-d43c-4f2f-9827-60d50f4eba7d tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 404 len: 111 microversion: 2.1 time: 0.029591 Aug 22 13:02:28.551553 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 571/1133] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 22 13:02:28 2022] DELETE /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 13:02:28.555494 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '>' {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:28.561132 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.compute.api [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] [instance: a4c83c81-7a50-4a24-a5c4-59c2af75792c] Fetching instance by UUID {{(pid=127809) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 13:02:28.562004 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:28.562538 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:28.562973 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:28.563674 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Acquiring lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 13:02:28.564128 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 13:02:28.564554 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG oslo_concurrency.lockutils [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Lock "9cc14116-d0bf-4920-ba82-d0258dbf20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 13:02:28.578381 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.wsgi [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] HTTP exception thrown: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Request method failure captured: Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: request: GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c HTTP/1.1 Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept: application/json Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Accept-Encoding: identity Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Connection: close Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Length: 0 Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Content-Type: application/json Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Host: 10.222.0.15 Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Openstack-System-Scope: None Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: User-Agent: python-urllib3/1.26.11 Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Auth-Token: gAAAAABjA3yTwuST5r9fL1c_dUZDanGAXYCGhSx7ErDhX51j-bsg-MclPAaHS2XiuibCslWy_d4pEBuGv-tu35_sCIEq6UFyHD4RSx-B4zqdWTeq7NEBinZ_f8HO1Hbbl147E5CEiK_eo0i7pqkm6uCc6wlbHSnpD5ZPIUCcENCUQpg1_CFakYE Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Id: None Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Domain-Name: None Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Identity-Status: Confirmed Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Is-Admin-Project: True Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Id: default Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Domain-Name: Default Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Id: 66ab7e2f4bbd43f4a795a5f1068a32f9 Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Project-Name: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Role: member,reader Aug 22 13:02:28.579923 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Roles: member,reader Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66ab7e2f4bbd43f4a795a5f1068a32f9"}]}] Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Id: 66ab7e2f4bbd43f4a795a5f1068a32f9 Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-Tenant-Name: tempest-TestVolumeBootPattern-288792624 Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User: tempest-TestVolumeBootPattern-288792624-project Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Id: default Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Domain-Name: Default Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Id: 35306cf75bde4fdcbb1374fa9ab82aa7 Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: X-User-Name: tempest-TestVolumeBootPattern-288792624-project Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: method: > Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: exception: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 13:02:28.581461 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: action_args: {'id': 'a4c83c81-7a50-4a24-a5c4-59c2af75792c'} Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: {{(pid=127809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 13:02:28.582336 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. Aug 22 13:02:28.583763 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: ERROR nova.api.openstack.wsgi Aug 22 13:02:28.585066 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: DEBUG nova.api.openstack.wsgi [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Returning 404 to user: Instance a4c83c81-7a50-4a24-a5c4-59c2af75792c could not be found. {{(pid=127809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 13:02:28.585066 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO nova.api.openstack.requestlog [None req-b62719b0-23bc-4fff-bdf1-38b2b0ddb740 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c" status: 404 len: 111 microversion: 2.1 time: 0.029661 Aug 22 13:02:28.585066 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: [pid: 127809|app: 0|req: 563/1134] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 22 13:02:28 2022] GET /compute/v2.1/servers/a4c83c81-7a50-4a24-a5c4-59c2af75792c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 13:02:30.125476 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: DEBUG nova.api.openstack.wsgi [None req-f5cabe0f-38e5-4554-a72a-49435c0577d2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] Calling method '.version_select at 0x7f7659ff9b80>' {{(pid=127810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 13:02:30.224605 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO nova.api.openstack.requestlog [None req-f5cabe0f-38e5-4554-a72a-49435c0577d2 tempest-TestVolumeBootPattern-288792624 tempest-TestVolumeBootPattern-288792624-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1880130090" status: 202 len: 0 microversion: 2.1 time: 0.103185 Aug 22 13:02:30.225187 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: [pid: 127810|app: 0|req: 572/1135] 10.222.0.15 () {58 vars in 1263 bytes} [Mon Aug 22 13:02:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1880130090 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 13:05:28.366742 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 13:05:28.367294 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Mon Aug 22 13:05:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 13:05:28.591736 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 13:05:28.592244 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Mon Aug 22 13:05:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 13:05:29.663346 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 13:05:29.664294 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Mon Aug 22 13:05:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 13:05:43.098446 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 13:05:43.099178 dv-cinder-850836-6-iscsi devstack@n-api.service[127809]: Mon Aug 22 13:05:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 13:05:43.279916 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 13:05:43.280456 dv-cinder-850836-6-iscsi devstack@n-api.service[127810]: Mon Aug 22 13:05:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!